cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Florin Dumitrascu <florin.dumitra...@intunenetworks.com>
Subject RE: OVS plugin communication failure (CS 4.3.0)
Date Tue, 01 Apr 2014 11:04:30 GMT
So I have this failure now which seems to be consistent.
A few details about the setup:

Host 5 is standalone (single host in cluster). Host 15 is in a cluster with host 16. There
is 1 VM instance running on host 5, 1 VM running on host 16, none running on host 15.
The tunnels  between hosts 5 and 16 have been created (on second attempt, first time, I got
the error in previous email).
Now I am starting a new instance on host 15 and the tunnel creation fails. I know there was
an issue with the tunnels on second host in the cluster (VM_REQUIRES_NETWORK), has this not
been fixed ?
Do you think the error in the ovstunnel.log on host 5 below is related ?

---------
2014-04-01 11:16:07    DEBUG [root] #### VMOPS enter  create_tunnel ####
2014-04-01 11:16:07    DEBUG [root] Entering create_tunnel
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', '--timeout=30', 'wait-until',
'bridge', 'xapi5', '--', 'get', 'bridge', 'xapi5', 'name']
2014-04-01 11:16:07    DEBUG [root] bridge xapi5 for creating tunnel - VERIFIED
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', 'add-port', 'xapi5',
't213-5-15', '--', 'set', 'interface', 't213-5-15', 'type=gre', 'options:key=213', 'options:remote_ip=10.20.1.22']
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', 'get', 'port', 't213-5-15',
'interfaces']
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', 'get', 'interface', 'f4344f02-be53-4297-9344-5d799c41c8bf',
'options:key']
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', 'get', 'interface', 'f4344f02-be53-4297-9344-5d799c41c8bf',
'options:remote_ip']
2014-04-01 11:16:07    DEBUG [root] Tunnel interface validated:['/usr/bin/ovs-vsctl', 'get',
'interface', 'f4344f02-be53-4297-9344-5d799c41c8bf', 'options:remote_ip']
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', 'get', 'interface', 'f4344f02-be53-4297-9344-5d799c41c8bf',
'ofport']
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-ofctl', 'add-flow', 'xapi5',
'hard_timeout=0,idle_timeout=0,priority=1000,in_port=-1,dl_dst=ff:ff:ff:ff:ff:ff,actions=drop']
2014-04-01 11:16:07    DEBUG [root] The command exited with the error code: 1 (stderr output:ovs-ofctl:
-1: negative values not supported for in_port
)
2014-04-01 11:16:07    DEBUG [root] An unexpected error occured. Rolling back
2014-04-01 11:16:07    DEBUG [root] Deleting GRE interface
2014-04-01 11:16:07    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', 'del-port', 'xapi5',
't213-5-15']
----------

Thanks,
Florin

-----Original Message-----
From: Florin Dumitrascu [mailto:florin.dumitrascu@intunenetworks.com]
Sent: Tuesday, April 01, 2014 9:37 AM
To: dev@cloudstack.apache.org
Subject: RE: OVS plugin communication failure (CS 4.3.0)

Murali, Benoit,

First, thanks for the tip, I knew about /var/log/ovstunnel.log from CS 4.1.1 but had no idea
it moved under "cloud" folder :) I am on a fresh installed setup.

So, looking at this log, I am seeing something that looks like this:

----
2014-03-31 22:01:26    DEBUG [root] Entering create_tunnel
2014-03-31 22:01:26    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', '--timeout=30', 'wait-until',
'bridge', 'xapi4', '--', 'get', 'bridge', 'xapi4', 'name']
2014-03-31 22:01:56    DEBUG [root] The command exited with the error code: -14 (stderr output:)
----

This is not happening all the time. A second attempt to create an instance did create the
tunnel successfully.
I was actually seeing something similar in our previous setup which was CS 4.1.1 + XenServer
6.1.0


Florin

-----Original Message-----
From: benoit lair [mailto:kurushi4000@gmail.com]
Sent: Tuesday, April 01, 2014 9:22 AM
To: dev@cloudstack.apache.org
Subject: Re: OVS plugin communication failure (CS 4.3.0)

Hello Florin,


Are you on a fresh install or on an upgraded version (from 4.1 ?)


Regards, Benoit.


2014-04-01 9:58 GMT+02:00 Murali Reddy <Murali.Reddy@citrix.com>:

> On 01/04/14 3:46 AM, "Florin Dumitrascu"
> <florin.dumitrascu@intunenetworks.com> wrote:
>
> >Hi,
> >
> >I am using CS 4.3.0 and XenServer 6.2.0 with SP1, on a GRE isolated
> >network.
> >The tunnel creation keeps failing intermittently with the error below
> >(failure communicating with the plugin).
> >Cloudstack management server can ping the xenserver reliably, there
> >doesn't seem to be any issue at the IP level.
> >Any idea what is causing this ?
>
> Do you see any relevant errors in /var/log/cloud/ovstunnel.log or
> /var/log/xensource.log
>
> >
> >Thanks
> >
> >2014-03-31 23:08:56,528 WARN  [c.c.h.x.r.CitrixResourceBase]
> >(DirectAgent-265:ctx-3ca23292) Caught execption when creating ovs
> >tunnel
> >com.cloud.utils.exception.CloudRuntimeException: callHostPlugin
> >failed for cmd: create_tunnel with args to: 5, remote_ip: 10.20.1.20,
> >from: 16, bridge: xapi4, key: 213,  due to There was a failure
> >communicating with the plugin.
> >        at
> >com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(C
> >itrix
> >ResourceBase.java:4239)
> >        at
> >com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixRe
> >sourc
> >eBase.java:5685)
> >        at
> >com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(C
> >itrix
> >ResourceBase.java:567)
> >        at
> >com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(
> >XenSe
> >rver56Resource.java:59)
> >        at
> >com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest
> >(XenS
> >erver610Resource.java:106)
> >        at
> >com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAg
> >entAt
> >tache.java:216)
> >
> >Florin
> >IMPORTANT NOTE: The information in this e-mail (and any attachments)
> >is confidential. The contents may not be disclosed or used by anyone
> >other than the addressee. If you are not the intended recipient,
> >please notify the sender immediately or telephone: +353 (0)1 6204700.
> >We cannot accept any responsibility for the accuracy or completeness
> >of this message as it has been transmitted over a public network. If
> >you suspect that the message may have been intercepted or amended, please call the
sender.
> >
>
>
>

IMPORTANT NOTE: The information in this e-mail (and any attachments) is confidential. The
contents may not be disclosed or used by anyone other than the addressee. If you are not the
intended recipient, please notify the sender immediately or telephone: +353 (0)1 6204700.
We cannot accept any responsibility for the accuracy or completeness of this message as it
has been transmitted over a public network. If you suspect that the message may have been
intercepted or amended, please call the sender.

IMPORTANT NOTE: The information in this e-mail (and any attachments) is confidential. The
contents may not be disclosed or used by anyone other than the addressee. If you are not the
intended recipient, please notify the sender immediately or telephone: +353 (0)1 6204700.
We cannot accept any responsibility for the accuracy or completeness of this message as it
has been transmitted over a public network. If you suspect that the message may have been
intercepted or amended, please call the sender.

Mime
View raw message