Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A44C910A8F for ; Sat, 28 Dec 2013 00:35:51 +0000 (UTC) Received: (qmail 77633 invoked by uid 500); 28 Dec 2013 00:35:50 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 77522 invoked by uid 500); 28 Dec 2013 00:35:50 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 77380 invoked by uid 500); 28 Dec 2013 00:35:50 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 77376 invoked by uid 99); 28 Dec 2013 00:35:50 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 Dec 2013 00:35:50 +0000 Date: Sat, 28 Dec 2013 00:35:50 +0000 (UTC) From: "angeline shen (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CLOUDSTACK-5664) XEN patch/hotfix certification - after XS 6.0.2 XS602E030 patch installation VMs deployed before patch installation does not acquire new rules set MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angeline shen updated CLOUDSTACK-5664: -------------------------------------- Environment: MS CloudPlatform-4.2.0-2-rhel6.4.tar.gz host 10.223.51.3 XS 6.0.2 base + HF XS602E001 to XS602E029 + CSPs 10.223.51.4 XS 6.0.2 base + HF XS602E001 to XS602E029 + CSPs was: MS CloudPlatform-4.2.1-2-rhel6.4.tar.gz host 10.223.51.3 XS 6.0.2 base + HF XS602E001 to XS602E029 + CSPs 10.223.51.4 XS 6.0.2 base + HF XS602E001 to XS602E029 + CSPs > XEN patch/hotfix certification - after XS 6.0.2 XS602E030 patch installation VMs deployed before patch installation does not acquire new rules set > --------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: CLOUDSTACK-5664 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5664 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the default.) > Components: Management Server > Affects Versions: 4.2.0 > Environment: MS CloudPlatform-4.2.0-2-rhel6.4.tar.gz > host 10.223.51.3 XS 6.0.2 base + HF XS602E001 to XS602E029 + CSPs > 10.223.51.4 XS 6.0.2 base + HF XS602E001 to XS602E029 + CSPs > Reporter: angeline shen > Priority: Critical > Fix For: 4.2.0 > > Attachments: 513SMlog, 513xensource.log, 513xenstored-access.log, 513xenstored-access.log.1, 513xenstored-access.log.2, 513xenstored-access.log.3, 514SMlog, 514xensource.log, 514xenstored-access.log, management-server.log.gz > > > http://wiki-ccp.citrix.com/pages/viewpage.action?pageId=11829631 : > XEN hotfix installation procedure > 1. Hosts master slave installed with > XS 6.0.2 base + Hotfix XS602E001 to XS602E029 + CSPs > 2. Basic zone with cluster of above master & slave hosts > security group default with NO security rules > Deploy two VMs > 3. MS: master host put to maintenance mode - VMs migrate to slave host > 4. MS: unmanage cluster > 5. master host: install hotfix XS602E030 + CSP , reboot master > 6. MS: master host cancel maintenance mode > 7. MS: manage cluster > 8. MS: slave host put to maintenance mode - VMs migrate to master host > 9. MS: Add security rules: ingress TCP 1 - 8090 0.0.0.0/0 > ingress ICMP -1 -1 0.0.0.0/0 > egress TCP 1 - 8090 0.0.0.0/0 > egress ICMP -1 -1 0.0.0.0/0 > 10. MS: slave host cancel maintenance mode > 11. stop/start SSVM VR > 12. Deploy two more VMs > Test result: > VMs deployed after HotFix XS602E030 installation correctly acquired 4 new ingress + egress rules > VMs deployed before HotFix XS602E030 installation did not acquire 4 new ingress & egress rules - error > Also there are errors encountered when attempt to apply these rules to old VMs: > 2013-12-27 12:14:37,294 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-21:job-21 = [ 94abc9ec-19fc-4d8b-916c-531e161c8525 ]) Done executing org.apache.cloudstack.api.command.user.securitygroup.AuthorizeSecurityGroupIngressCmd for job-21 = [ 94abc9ec-19fc-4d8b-916c-531e161c8525 ] > 2013-12-27 12:14:37,471 WARN [xen.resource.CitrixResourceBase] (DirectAgent-204:null) callHostPlugin failed for cmd: network_rules with args seqno: 8, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztCpJLrAytLIwsDSwMtADQ30DHT/XiBAFAGbLBq8=, signature: 8683b82a9b77d8ece0dd135304fbdb8a, due to There was a failure communicating with the plugin. > 2013-12-27 12:14:37,472 WARN [agent.manager.DirectAgentAttache] (DirectAgent-204:null) Seq 1-1198391355: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 8, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztCpJLrAytLIwsDSwMtADQ30DHT/XiBAFAGbLBq8=, signature: 8683b82a9b77d8ece0dd135304fbdb8a, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:14:37,473 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-204:null) Seq 1-1198391355: Response Received: > 2013-12-27 12:14:37,473 DEBUG [agent.transport.Request] (DirectAgent-204:null) Seq 1-1198391355: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 8, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztCpJLrAytLIwsDSwMtADQ30DHT/XiBAFAGbLBq8=, signature: 8683b82a9b77d8ece0dd135304fbdb8a, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:14:37,474 DEBUG [agent.manager.AgentAttache] (DirectAgent-204:null) Seq 1-1198391356: Sending now. is current sequence. > 2013-12-27 12:14:37,474 DEBUG [agent.transport.Request] (DirectAgent-204:null) Seq 1-1198391356: Executing: { Cmd , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.SecurityGroupRulesCmd":{"guestIp":"10.223.51.28","vmName":"i-2-3-VM","guestMac":"06:23:d0:00:00:0e","signature":"8683b82a9b77d8ece0dd135304fbdb8a","seqNum":8,"vmId":3,"msId":7450358974323,"ingressRuleSet":[{"proto":"tcp","startPort":1,"endPort":8090}],"egressRuleSet":[],"wait":0}}] } > 2013-12-27 12:14:37,475 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-80:null) Seq 1-1198391356: Executing request > 2013-12-27 12:14:37,670 WARN [xen.resource.CitrixResourceBase] (DirectAgent-80:null) callHostPlugin failed for cmd: network_rules with args seqno: 8, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztCpJLrAytLIwsDSwMtADQ30DHT/XiBAFAGbLBq8=, signature: 8683b82a9b77d8ece0dd135304fbdb8a, due to There was a failure communicating with the plugin. > 2013-12-27 12:14:37,670 WARN [agent.manager.DirectAgentAttache] (DirectAgent-80:null) Seq 1-1198391356: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 8, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztCpJLrAytLIwsDSwMtADQ30DHT/XiBAFAGbLBq8=, signature: 8683b82a9b77d8ece0dd135304fbdb8a, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:14:37,672 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-80:null) Seq 1-1198391356: Response Received: > 2013-12-27 12:14:37,672 DEBUG [agent.transport.Request] (DirectAgent-80:null) Seq 1-1198391356: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 8, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztCpJLrAytLIwsDSwMtADQ30DHT/XiBAFAGbLBq8=, signature: 8683b82a9b77d8ece0dd135304fbdb8a, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:14:58,272 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-22:job-22 = [ 3c5cfc1e-7c8a-4681-ba0b-26f29148345e ]) Done executing org.apache.cloudstack.api.command.user.securitygroup.AuthorizeSecurityGroupIngressCmd for job-22 = [ 3c5cfc1e-7c8a-4681-ba0b-26f29148345e ] > 2013-12-27 12:14:58,444 WARN [xen.resource.CitrixResourceBase] (DirectAgent-208:null) callHostPlugin failed for cmd: network_rules with args seqno: 9, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJcDAI5RDXk=, signature: a9fa64030991745ba7b9513b2d68a64e, due to There was a failure communicating with the plugin. > 2013-12-27 12:14:58,444 WARN [agent.manager.DirectAgentAttache] (DirectAgent-208:null) Seq 1-1198391360: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 9, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJcDAI5RDXk=, signature: a9fa64030991745ba7b9513b2d68a64e, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:14:58,446 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-208:null) Seq 1-1198391360: Response Received: > 2013-12-27 12:14:58,446 DEBUG [agent.transport.Request] (DirectAgent-208:null) Seq 1-1198391360: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 9, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJcDAI5RDXk=, signature: a9fa64030991745ba7b9513b2d68a64e, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:14:58,446 DEBUG [agent.manager.AgentAttache] (DirectAgent-208:null) Seq 1-1198391361: Sending now. is current sequence. > 2013-12-27 12:14:58,447 DEBUG [agent.transport.Request] (DirectAgent-208:null) Seq 1-1198391361: Executing: { Cmd , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.SecurityGroupRulesCmd":{"guestIp":"10.223.51.28","vmName":"i-2-3-VM","guestMac":"06:23:d0:00:00:0e","signature":"a9fa64030991745ba7b9513b2d68a64e","seqNum":9,"vmId":3,"msId":7450358974323,"ingressRuleSet":[{"proto":"icmp","startPort":-1,"endPort":-1},{"proto":"tcp","startPort":1,"endPort":8090}],"egressRuleSet":[],"wait":0}}] } > 2013-12-27 12:14:58,447 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-207:null) Seq 1-1198391361: Executing request > 2013-12-27 12:14:58,533 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) SeqA 3-777: Processing Seq 3-777: { Cmd , MgmtId: -1, via: 3, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } > 2013-12-27 12:14:58,543 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) SeqA 3-777: Sending Seq 3-777: { Ans: , MgmtId: 7450358974323, via: 3, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } > 2013-12-27 12:14:58,651 WARN [xen.resource.CitrixResourceBase] (DirectAgent-207:null) callHostPlugin failed for cmd: network_rules with args seqno: 9, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJcDAI5RDXk=, signature: a9fa64030991745ba7b9513b2d68a64e, due to There was a failure communicating with the plugin. > 2013-12-27 12:14:58,651 WARN [agent.manager.DirectAgentAttache] (DirectAgent-207:null) Seq 1-1198391361: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 9, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJcDAI5RDXk=, signature: a9fa64030991745ba7b9513b2d68a64e, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:14:58,653 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-207:null) Seq 1-1198391361: Response Received: > 2013-12-27 12:14:58,653 DEBUG [agent.transport.Request] (DirectAgent-207:null) Seq 1-1198391361: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 9, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJcDAI5RDXk=, signature: a9fa64030991745ba7b9513b2d68a64e, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:14:58,653 DEBUG [agent.manager.AgentAttache] (DirectAgent-207:null) Seq 1-1198391361: No more commands found > 2013-12-27 12:15:39,286 WARN [xen.resource.CitrixResourceBase] (DirectAgent-210:null) callHostPlugin failed for cmd: network_rules with args seqno: 10, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: > 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxSMHAG3qFCM=, signature: d6421ea3aa7afd8768099104b96f357b, due to There was a failure communicating with the plugin. > 2013-12-27 12:15:39,286 WARN [agent.manager.DirectAgentAttache] (DirectAgent-210:null) Seq 1-1198391363: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 10, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, > rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxSMHAG3qFCM=, signature: d6421ea3aa7afd8768099104b96f357b, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:15:39,287 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-210:null) Seq 1-1198391363: Response Received: > 2013-12-27 12:15:39,288 DEBUG [agent.transport.Request] (DirectAgent-210:null) Seq 1-1198391363: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":fals > e,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 10, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmNam > e: i-2-3-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxSMHAG3qFCM=, signature: d6421ea3aa7afd8768099104b96f357b, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:15:39,288 DEBUG [agent.manager.AgentAttache] (DirectAgent-210:null) Seq 1-1198391364: Sending now. is current sequence. > 2013-12-27 12:15:39,289 DEBUG [agent.transport.Request] (DirectAgent-210:null) Seq 1-1198391364: Executing: { Cmd , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.SecurityGroupRulesCmd > ":{"guestIp":"10.223.51.30","vmName":"i-2-5-VM","guestMac":"06:37:9c:00:00:10","signature":"d6421ea3aa7afd8768099104b96f357b","seqNum":10,"vmId":5,"msId":7450358974323,"ingressRuleSet":[{"proto":"icmp","startPort":-1 > ,"endPort":-1},{"proto":"tcp","startPort":1,"endPort":8090}],"egressRuleSet":[{"proto":"tcp","startPort":1,"endPort":8090}],"wait":0}}] } > 2013-12-27 12:15:39,289 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-82:null) Seq 1-1198391364: Executing request > 2013-12-27 12:15:39,474 WARN [xen.resource.CitrixResourceBase] (DirectAgent-82:null) callHostPlugin failed for cmd: network_rules with args seqno: 10, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: > 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxSMHAG3qFCM=, signature: d6421ea3aa7afd8768099104b96f357b, due to There was a failure communicating with the plugin. > 2013-12-27 12:15:39,475 WARN [agent.manager.DirectAgentAttache] (DirectAgent-82:null) Seq 1-1198391364: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 10, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, > rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxSMHAG3qFCM=, signature: d6421ea3aa7afd8768099104b96f357b, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:15:39,476 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-82:null) Seq 1-1198391364: Response Received: > 2013-12-27 12:15:39,476 DEBUG [agent.transport.Request] (DirectAgent-82:null) Seq 1-1198391364: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":false > ,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 10, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName > : i-2-5-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxSMHAG3qFCM=, signature: d6421ea3aa7afd8768099104b96f357b, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:15:39,476 DEBUG [agent.manager.AgentAttache] (DirectAgent-82:null) Seq 1-1198391364: No more commands found > 2013-12-27 12:15:41,999 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===START=== 10.215.3.21 -- GET command=queryAsyncJobResult&jobId=c78cd732-a868-4b59-bbf9-1059927659f2&response=json&sessionkey=Z0RcI6H9h9 > fxkE8ZyLHln00cQs0%3D&_=1388175683610 > 2013-12-27 12:15:42,021 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-19:null) Async job-23 = [ c78cd732-a868-4b59-bbf9-1059927659f2 ] completed > 2013-12-27 12:15:42,030 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===END=== 10.215.3.21 -- GET command=queryAsyncJobResult&jobId=c78cd732-a868-4b59-bbf9-1059927659f2&response=json&sessionkey=Z0RcI6H9h9fx > kE8ZyLHln00cQs0%3D&_=1388175683610 > 2013-12-27 12:15:42,058 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===START=== 10.215.3.21 -- GET command=listSecurityGroups&response=json&sessionkey=Z0RcI6H9h9fxkE8ZyLHln00cQs0%3D&id=f62dd658-6f26-11e3-a > 6e9-06c6ac000773&_=1388175683674 > 2013-12-27 12:15:55,362 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-24:job-24 = [ f6585387-b847-44d9-bae1-ff4f2d046872 ]) Done executing org.apache.cloudstack.api.command.user.securitygroup.AuthorizeSecurit > yGroupEgressCmd for job-24 = [ f6585387-b847-44d9-bae1-ff4f2d046872 ] > 2013-12-27 12:15:55,520 WARN [xen.resource.CitrixResourceBase] (DirectAgent-212:null) callHostPlugin failed for cmd: network_rules with args seqno: 11, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: > 06:23:d0:00:00:0e, vmName: i-2-3-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxaPPFY8+AA3OGuk=, signature: 9e84fe5a0d5f7b414fa5b09d1e324874, due to There was a failure communicating with the plugi > n. > 2013-12-27 12:15:55,521 WARN [agent.manager.DirectAgentAttache] (DirectAgent-212:null) Seq 1-1198391366: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 11, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmName: i-2-3-VM, > rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxaPPFY8+AA3OGuk=, signature: 9e84fe5a0d5f7b414fa5b09d1e324874, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:15:55,522 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-212:null) Seq 1-1198391366: Response Received: > 2013-12-27 12:15:55,522 DEBUG [agent.transport.Request] (DirectAgent-212:null) Seq 1-1198391366: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":fals > e,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 11, vmIP: 10.223.51.28, deflated: true, secIps: 0:, vmID: 3, vmMAC: 06:23:d0:00:00:0e, vmNam > e: i-2-3-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxaPPFY8+AA3OGuk=, signature: 9e84fe5a0d5f7b414fa5b09d1e324874, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:15:55,523 DEBUG [agent.manager.AgentAttache] (DirectAgent-212:null) Seq 1-1198391367: Sending now. is current sequence. > 2013-12-27 12:15:55,523 DEBUG [agent.transport.Request] (DirectAgent-212:null) Seq 1-1198391367: Executing: { Cmd , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.SecurityGroupRulesCmd > ":{"guestIp":"10.223.51.30","vmName":"i-2-5-VM","guestMac":"06:37:9c:00:00:10","signature":"9e84fe5a0d5f7b414fa5b09d1e324874","seqNum":11,"vmId":5,"msId":7450358974323,"ingressRuleSet":[{"proto":"icmp","startPort":-1 > ,"endPort":-1},{"proto":"tcp","startPort":1,"endPort":8090}],"egressRuleSet":[{"proto":"icmp","startPort":-1,"endPort":-1},{"proto":"tcp","startPort":1,"endPort":8090}],"wait":0}}] } > 2013-12-27 12:15:55,524 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-32:null) Seq 1-1198391367: Executing request > 2013-12-27 12:15:55,713 WARN [xen.resource.CitrixResourceBase] (DirectAgent-32:null) callHostPlugin failed for cmd: network_rules with args seqno: 11, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: > 06:37:9c:00:00:10, vmName: i-2-5-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxaPPFY8+AA3OGuk=, signature: 9e84fe5a0d5f7b414fa5b09d1e324874, due to There was a failure communicating with the plugin > . > 2013-12-27 12:15:55,714 WARN [agent.manager.DirectAgentAttache] (DirectAgent-32:null) Seq 1-1198391367: Exception Caught while executing command > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 11, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName: i-2-5-VM, > rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxaPPFY8+AA3OGuk=, signature: 9e84fe5a0d5f7b414fa5b09d1e324874, due to There was a failure communicating with the plugin. > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4181) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5775) > at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:565) > at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-12-27 12:15:55,715 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-32:null) Seq 1-1198391367: Response Received: > 2013-12-27 12:15:55,716 DEBUG [agent.transport.Request] (DirectAgent-32:null) Seq 1-1198391367: Processing: { Ans: , MgmtId: 7450358974323, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":false > ,"details":"com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: network_rules with args seqno: 11, vmIP: 10.223.51.30, deflated: true, secIps: 0:, vmID: 5, vmMAC: 06:37:9c:00:00:10, vmName > : i-2-5-VM, rules: eJzztMpMzi2w0jUEIQM9MNQ30PFzjQhR8LQqSS6wMrSyMLA0QJdzxaPPFY8+AA3OGuk=, signature: 9e84fe5a0d5f7b414fa5b09d1e324874, due to There was a failure communicating with the plugin.","wait":0}}] } > 2013-12-27 12:15:55,716 DEBUG [agent.manager.AgentAttache] (DirectAgent-32:null) Seq 1-1198391367: No more commands found > 2013-12-27 12:15:55,763 DEBUG [cloud.server.StatsCollector] (StatsCollector-1:null) VmStatsCollector is running... -- This message was sent by Atlassian JIRA (v6.1.5#6160)