Return-Path: X-Original-To: apmail-incubator-cloudstack-users-archive@minotaur.apache.org Delivered-To: apmail-incubator-cloudstack-users-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5FEBBE797 for ; Wed, 9 Jan 2013 09:41:22 +0000 (UTC) Received: (qmail 30668 invoked by uid 500); 9 Jan 2013 09:41:22 -0000 Delivered-To: apmail-incubator-cloudstack-users-archive@incubator.apache.org Received: (qmail 30377 invoked by uid 500); 9 Jan 2013 09:41:21 -0000 Mailing-List: contact cloudstack-users-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cloudstack-users@incubator.apache.org Delivered-To: mailing list cloudstack-users@incubator.apache.org Received: (qmail 30355 invoked by uid 99); 9 Jan 2013 09:41:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jan 2013 09:41:21 +0000 X-ASF-Spam-Status: No, hits=3.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL,T_FILL_THIS_FORM_SHORT,URIBL_GREY X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.210.182] (HELO mail-ia0-f182.google.com) (209.85.210.182) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jan 2013 09:41:15 +0000 Received: by mail-ia0-f182.google.com with SMTP id x2so1273668iad.41 for ; Wed, 09 Jan 2013 01:40:54 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:x-gm-message-state; bh=GlFtnVccs2zXR3XjwESYsXvm0wqN8V3hYhG8slZdDvo=; b=S7cHsklBoyj9vs1XgxUgRaqypuYr9w9d4Vb4hbnyhC8pyMn4aLx2oESVRPruSQYo57 wE0IM98KpO7PgnSz7E39oH1j/AWMrMMui6gHHGjbVpSRKO4qNq4Vo5FAjyRk7DYnZe0p xeekRq8U2BzjFsT88hLYP2xM6shtuA43rEGYGhW0sHrA1b1zad1ofS9uCNhupzrqtmmP V/b4rtcet989Ert8qOl8VylAvhMB+yWlq0R9AkJ2mGim6yy2JEKPfmQ7qh7pvmbblHeC Ycu/YHA/iBPxc0rlR8jcvnz5PiOucyzMg36BGTj9K53MyqKXKDd4Xn+XRAygxbBofWcm Nu9w== MIME-Version: 1.0 Received: by 10.50.196.227 with SMTP id ip3mr888218igc.97.1357724454193; Wed, 09 Jan 2013 01:40:54 -0800 (PST) Received: by 10.50.106.230 with HTTP; Wed, 9 Jan 2013 01:40:54 -0800 (PST) In-Reply-To: References: <002d01cdee46$453f7340$cfbe59c0$@changingworkplace.com> Date: Wed, 9 Jan 2013 10:40:54 +0100 Message-ID: Subject: Re: Cloudstack Xen Host High Availability and Fencing From: Arnaud Gaillard To: cloudstack-users@incubator.apache.org Cc: "tom.bean@changingworkplace.com" Content-Type: multipart/alternative; boundary=14dae934117bcb8a3604d2d7db5e X-Gm-Message-State: ALoCoQn09RcPrEi/QoqRxmPrc7CHMFZcdxqmdqIy5WUJMZ5p2Hwi2Q+wBth/sEZrywBzXfAJ5HPv X-Virus-Checked: Checked by ClamAV on apache.org --14dae934117bcb8a3604d2d7db5e Content-Type: text/plain; charset=ISO-8859-1 Hello, Yes we encountered the same problem but with KVM. It seems that when you are in a multiple primary storage configuration and one of the primary storage become unavailable the default behaviour is to reboot the hosts... (even if the primary storage was not used for VM on this hosts). This may end up in really critical situation. For me this behaviour doesn't make sense, and may create a lot of side effect. We ended up modifying the HA script to ensure that it will never reboot our hosts. I think that a bug should be raised but I'm not sure if there is a hidden goal behind this behaviour. Regards, Arnaud On Wed, Jan 9, 2013 at 10:01 AM, Geoff Higginbottom < geoff.higginbottom@shapeblue.com> wrote: > Hi Tom > > This is the way it works by design. For each XenServer modify: > /opt/xensource/bin/xenheartbeat.sh > > Locate the two instances of "reboot -f" and comment them out by placing a > # in front. > > Then kill the script followed by a force reconnect from the GUGI (or > reboot each XenServer) > pidof -x xenheartbeat.sh > kill > > Regards > > Geoff Higginbottom > > D: +44 20 3603 0542 | S: +44 20 3603 0540 +442036030540> | M: +447968161581 > > geoff.higginbottom@shapeblue.com > > From: Tom Bean [mailto:tom.bean@changingworkplace.com] > Sent: 09 January 2013 08:50 > To: cloudstack-users@incubator.apache.org > Subject: Cloudstack Xen Host High Availability and Fencing > > Hi All, > > I have stumbled across an issue/feature with Cloudstack (3.0.2) yesterday > which was a little worrying. > > I was working on a primary storage which was added through Cloudstack but > had no VM's stored on it, so I did not think this would cause any issues. > > While I was working on this storage device, it became unavailable for > around 5 minutes, when it became unavailable all my Xen servers fenced, > rebooted and all my VM's shut down and one Xen server has now become > corrupted. > > I have tested this again on a second pool I have in cloudstack and when > the primary storage becomes unavailable all the Hosts reboot. > > What I want to know is: > > > 1. Is there any way to disable this? > > 2. It seems that in a pool where I have 5 storage repositories, if any > of them become unavailable, all of the hosts shut down. Is there a way to > specify the heart beat files be stored on a specific primary SR? > > > Tom Bean > > > > Infrastructure & Support Analyst > > > The Changing Workplace > > Phone: > Fax: > Email: > Skype: > Address: > Website: > News: > > +44 (0)1444 44 1000 ext 316 > +44 (0)1444 44 0944 > tom.bean@changingworkplace.com > Contact me via Skype > 1 Boltro Road, Haywards Heath, RH16 1BY, United Kingdom > changingworkplace.com > Sign up for our newsletter< > http://visitor.r20.constantcontact.com/d.jsp?llr=wbsdkygab&p=oi&m=1106769987638 > > > > [Description: C:\Users\tomb\AppData\Roaming\Microsoft\Signatures\Tom > Bean_files\image001.gif][Description: > C:\Users\tomb\AppData\Roaming\Microsoft\Signatures\Tom > Bean_files\image002.gif][Description: > C:\Users\tomb\AppData\Roaming\Microsoft\Signatures\Tom > Bean_files\image003.gif]< > http://www.linkedin.com/company/the-changing-workplace> > > Changing the world we work in by providing best-in-class software services > to the Corporate Real Estate sector > > Please don't print this e-mail unless you really need to > > > > > > Important Information > > This e-mail and the information it contains are confidential and/or > privileged and are intended solely for the named recipient/s. If you have > received this e-mail in error please notify the sender immediately and > delete this email. You should not copy it for any purpose, or disclose its > contents to any other person. > > The Changing Workplace cannot accept any responsibility for the accuracy > or completeness of the contents of this e-mail as it has been transmitted > over a public network and Internet communications are not secure. > > The views expressed in this message are those of the individual sender, > except where specifically stated to be the view of The Changing Workplace. > All statements made in this e-mail are subject to contract. The contents > are not to be regarded as a contractual offer or acceptance. The sender is > not authorised to bind The Changing Workplace contractually. > > The Changing Workplace cannot guarantee that attachments are virus-free or > compatible with your systems and does not accept any liability in respect > of viruses or computer problems experienced. > > The Changing Workplace is a limited company registered in England and > Wales under company number 3614433 whose registered office is at 1 Boltro > Road, Haywards Heath, West Sussex, RH16 1BY, United Kingdom. > ShapeBlue provides a range of strategic and technical consulting and > implementation services to help IT Service Providers and Enterprises to > build a true IaaS compute cloud. ShapeBlue's expertise, combined with > CloudStack technology, allows IT Service Providers and Enterprises to > deliver true, utility based, IaaS to the customer or end-user. > > ________________________________ > > This email and any attachments to it may be confidential and are intended > solely for the use of the individual to whom it is addressed. Any views or > opinions expressed are solely those of the author and do not necessarily > represent those of Shape Blue Ltd. If you are not the intended recipient of > this email, you must neither take any action based upon its contents, nor > copy or show it to anyone. Please contact the sender if you believe you > have received this email in error. Shape Blue Ltd is a company incorporated > in England & Wales. > --14dae934117bcb8a3604d2d7db5e--