From users-return-31019-archive-asf-public=cust-asf.ponee.io@cloudstack.apache.org Fri Jul 20 10:33:52 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 22D01180663 for ; Fri, 20 Jul 2018 10:33:51 +0200 (CEST) Received: (qmail 53672 invoked by uid 500); 20 Jul 2018 08:33:45 -0000 Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@cloudstack.apache.org Delivered-To: mailing list users@cloudstack.apache.org Received: (qmail 53660 invoked by uid 99); 20 Jul 2018 08:33:45 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jul 2018 08:33:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id C5E24C00C7 for ; Fri, 20 Jul 2018 08:33:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.888 X-Spam-Level: * X-Spam-Status: No, score=1.888 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id KFXw8yIrqlfK for ; Fri, 20 Jul 2018 08:33:43 +0000 (UTC) Received: from mail-io0-f171.google.com (mail-io0-f171.google.com [209.85.223.171]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id BC12F5F3AA for ; Fri, 20 Jul 2018 08:33:42 +0000 (UTC) Received: by mail-io0-f171.google.com with SMTP id g11-v6so9323472ioq.9 for ; Fri, 20 Jul 2018 01:33:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=Vk5I62ECa3JrxnskJbesNtVzSonHXk0loKghAr81C3U=; b=smvwEIhjx3EfXA+MKbsYjHQoNMXCbAQr5PfzmyLZogsIJIRTpza90WQhrW8qh7Qxcb 44zIZhG/wB9KfjZmzMmSse4kYyUm8qFbdKAna3oxQ8s6Wj9NszsrR3wHGjYcJ0+OL/u3 BQ91+TxvnV7LfYFQGosJiJkctOXGBrSMtPwQwtD2cs9SPjr7J+aQCJ0tQxBySujEOCWy g+Wrdm7ICa82GFDrxtJk3S9MyRY324VSAZAdPYp3krFvbu8P6nDkV6fpNy0B5jFFNMWy 2YI5TpJBvrN3IohgBMAoQGKWrQT40vJnbJDBVCAEIg1lNxxjBoJVCvfvQ0uLpi3W6sFP Fglg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=Vk5I62ECa3JrxnskJbesNtVzSonHXk0loKghAr81C3U=; b=Qnwql1FJQvoNOoF2qc4xWCeLNCIkeXdavQqLvWHm7JuL+yXz19BaLy2D1qrqhbAFo4 gqYsMHCzlcpp6J45UaqRt9Y/oaPXelrLhUtKupDb/1oMSqulUQ2zWQcIU3Cbh5Vgi6gG s5WnsS7fz47MaiJ0Xo0GWs3hXB4H/+Bxz5cr5exQQapv+KiNxrVW4TthSrsPnWCCVIkm /HK3zh6Z8ifDLwBUTHbmxEmUdwvGnulx/Wo54PGx3hWtSh4zgesSqQoaQwR3NnUqkAF3 fM0HjlGXlG6bRYnLzBvHrBMPizYn4mype3ftS0WcRa4TdItMhVqRf+U/uht+3We8kngg DeDg== X-Gm-Message-State: AOUpUlEYGf6E+jXYT/IAGJoBv75+R8ljLlJvqmLcDARtHwiyAeO0lZxr xF+W0gxIeqNx5dUeJvwMUM3CXRobQ+OQk83FNi0WrPRGpdk= X-Google-Smtp-Source: AAOMgpcp8htFj026NPQ4fTJ2UTccBGpTR/MR6b9HMHc73lR3FEiUeL73rKT5uuX8T5i/UcfIBTsfcX0ApW5v2EmPYVc= X-Received: by 2002:a6b:8dc7:: with SMTP id p190-v6mr829296iod.303.1532075621321; Fri, 20 Jul 2018 01:33:41 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Jevgeni Zolotarjov Date: Fri, 20 Jul 2018 11:33:28 +0300 Message-ID: Subject: Re: 4.11.0 -> 4.11.1 problem: Guest VMs losing connection after few minutes To: users@cloudstack.apache.org Content-Type: multipart/alternative; boundary="0000000000002d917905716a2708" --0000000000002d917905716a2708 Content-Type: text/plain; charset="UTF-8" - an ip-address conflict. JZ: unlikely, but not impossible. I tried to restart router VM in Network-Guest networks -> defaultGuestNetwork -> VirtualAppliances While rebooting ping to this router VM disappeared. Hence, no other device is using the same IP. But!!! when this virtual router started, then network connection to all guest VMs disappeared. So, it must be something with this virtual router. - flakey hardware being one of -+ if card in the host JZ: higly unlikely -+ a router with bad firmware JZ: also unlikely - of course a strange cofiguration of the software router in you host might be the issue as well JZ: I didnt do any special configuration. Just used default. by all I know this happening after upgrade sounds like an unhappy incident but can't be sure. The iptables restart, was this on the VirtualRouter or on the host, or maybe on the guest? and the restart network? JZ: iptables restart on host machine. (or network restart on host) On Fri, Jul 20, 2018 at 11:14 AM Daan Hoogland wrote: > that behaviour sound familiar from a couple of cases: > - an ip-address conflict. > - flakey hardware being one of > -+ if card in the host > -+ a router with bad firmware > - of course a strange cofiguration of the software router in you host might > be the issue as well > > by all I know this happening after upgrade sounds like an unhappy incident > but can't be sure. > The iptables restart, was this on the VirtualRouter or on the host, or > maybe on the guest? and the restart network? > > > On Fri, Jul 20, 2018 at 7:43 AM, Jevgeni Zolotarjov < > j.zolotarjov@gmail.com> > wrote: > > > I updated cloudstack 4.11.0 -> 4.11.1 > > > > Everything went OK during update, but after host reboot guest VMs lost > > connection after few minutes of normal work. > > I tried restarting network - systemctl restart network.service > > then connection was restored again for few minutes > > > > Finally I could restore connection by restarting iptables - systemctl > > restart iptables.service > > > > But then again guest VMs lost connection after few minutes of normal > > operation. > > The time of normal operation can be 5 minutes, but sometimes up to 40 > > minutes. > > > > Please help me to track the root cause and fix it > > > > Host OS - Centos 7.5 > > virtualisation - KVM > > > > > > -- > Daan > --0000000000002d917905716a2708--