From users-return-31023-archive-asf-public=cust-asf.ponee.io@cloudstack.apache.org Fri Jul 20 13:19:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 6A5AB180663 for ; Fri, 20 Jul 2018 13:19:04 +0200 (CEST) Received: (qmail 67468 invoked by uid 500); 20 Jul 2018 11:19:03 -0000 Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@cloudstack.apache.org Delivered-To: mailing list users@cloudstack.apache.org Received: (qmail 67455 invoked by uid 99); 20 Jul 2018 11:19:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jul 2018 11:19:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 1AFFA1809A9 for ; Fri, 20 Jul 2018 11:19:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.869 X-Spam-Level: ** X-Spam-Status: No, score=2.869 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 87KHD4B92Qbi for ; Fri, 20 Jul 2018 11:19:00 +0000 (UTC) Received: from mail-oi0-f54.google.com (mail-oi0-f54.google.com [209.85.218.54]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id B8C255F3AC for ; Fri, 20 Jul 2018 11:18:59 +0000 (UTC) Received: by mail-oi0-f54.google.com with SMTP id w126-v6so20667302oie.7 for ; Fri, 20 Jul 2018 04:18:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=RkX/N16Okywc3Yj33Z6VwJ3Xiq+1xFWyatoDnfLANsI=; b=W0ELC3ohCTaRKkgAOpcHCP++Rz6TPog9Kcp78hPEHeprxLtgYvA4c0IHfnV7DTQ39g SpesW4zgvb2rNklny8hurSxbMfo4+QSI6wXy3r1CeA4988b7gdYG2S1Y2sGtyX2Xz00r bY3n+Px0xUXLkT7bLezjgr5zut+hIJFGYUPLppEeowsrZglaPdc5oVeZKNlyWxONSLmm BU2Yxw8e1gxJo8Nx0MnZ98D3TdqcmTlX+wPG36PcxA2zj1SPPK2OfJtsVrSmR5F1x/ny KiNVNXck11GqunYZZikG9VthmGXD1Q2L1efL6GazyGnQ/gazZiHieB1/9b99Dt2j8KBL sA5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=RkX/N16Okywc3Yj33Z6VwJ3Xiq+1xFWyatoDnfLANsI=; b=WW+6ChLaItcqYCuOTpBBkQzK/YEhZCpTTThyHp2Ac7PlPNa5oP1LR0Jtgk/O1R+vei PNMCaptTSYJIBgHoVeDGJAPLv+ZpoxsgT2CChQN5naXLKZgkXaBCmut+Ng0NfFFql9Xy ldTMMlGpXzTewqxXxCHWbe40Wn11+PnsOFeu+xA22dUxds0rQPy1brot+e44rzjWaMIG L7DmSbqDQPvFCwPFpzFMMkXLzDl7t7Smx/wqeQpdqSRJ9aaxu22WrxhWPtxBZetyiw+q Q49UMMcanldyXkPWytgsJcqDtnUw478nbR+qb93cxkAG1PbMJelJTFMXP3VqN+2vkYPg Z2oA== X-Gm-Message-State: AOUpUlFLN4p01fryMY0cz9W0sS1HNoKi6VI6072SO27frz0TAa1k0kij N6ZmgbZHpjnhTR/VkGk7PxDZTNHVnAYjz4liSyD0bw== X-Google-Smtp-Source: AAOMgpegCj5vrzyG3zIy1AlQmxzk3Yz3nfr9BfsOj146YQayZXLt/gU5qGrAJKIxXk6DfDpcoc0YzAQsAoA9pTYEWbk= X-Received: by 2002:a54:4e8b:: with SMTP id c11-v6mr1459747oiy.187.1532085538203; Fri, 20 Jul 2018 04:18:58 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Andrija Panic Date: Fri, 20 Jul 2018 13:18:47 +0200 Message-ID: Subject: Re: 4.11.0 -> 4.11.1 problem: Guest VMs losing connection after few minutes To: users Content-Type: multipart/alternative; boundary="000000000000452ca905716c762b" --000000000000452ca905716c762b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable using vxlan as isolation method for advance network ? On Fri, 20 Jul 2018 at 11:29, Daan Hoogland wrote= : > On Fri, Jul 20, 2018 at 9:09 AM, ilya musayev < > ilya.mailing.lists@gmail.com> > wrote: > > > Have you tried destroying router vm and let CloudStack create new one ? > > > =E2=80=8Byes, or restart network with cleanup > > =E2=80=8B > > > > > > On Fri, Jul 20, 2018 at 1:33 AM Jevgeni Zolotarjov < > j.zolotarjov@gmail.com > > > > > wrote: > > > > > - an ip-address conflict. > > > JZ: unlikely, but not impossible. I tried to restart router VM in > > > Network-Guest networks -> defaultGuestNetwork -> VirtualAppliances > > > While rebooting ping to this router VM disappeared. Hence, no other > > device > > > is using the same IP. > > > But!!! when this virtual router started, then network connection to a= ll > > > guest VMs disappeared. So, it must be something with this virtual > router. > > > > > > - flakey hardware being one of > > > -+ if card in the host > > > JZ: higly unlikely > > > > > > -+ a router with bad firmware > > > JZ: also unlikely > > > > > > - of course a strange cofiguration of the software router in you host > > might > > > be the issue as well > > > JZ: I didnt do any special configuration. Just used default. > > > > > > by all I know this happening after upgrade sounds like an unhappy > > incident > > > but can't be sure. > > > The iptables restart, was this on the VirtualRouter or on the host, o= r > > > maybe on the guest? and the restart network? > > > > > > JZ: iptables restart on host machine. (or network restart on host) > > > > > > > > > > > > On Fri, Jul 20, 2018 at 11:14 AM Daan Hoogland < > daan.hoogland@gmail.com> > > > wrote: > > > > > > > that behaviour sound familiar from a couple of cases: > > > > - an ip-address conflict. > > > > - flakey hardware being one of > > > > -+ if card in the host > > > > -+ a router with bad firmware > > > > - of course a strange cofiguration of the software router in you ho= st > > > might > > > > be the issue as well > > > > > > > > by all I know this happening after upgrade sounds like an unhappy > > > incident > > > > but can't be sure. > > > > The iptables restart, was this on the VirtualRouter or on the host, > or > > > > maybe on the guest? and the restart network? > > > > > > > > > > > > On Fri, Jul 20, 2018 at 7:43 AM, Jevgeni Zolotarjov < > > > > j.zolotarjov@gmail.com> > > > > wrote: > > > > > > > > > I updated cloudstack 4.11.0 -> 4.11.1 > > > > > > > > > > Everything went OK during update, but after host reboot guest VMs > > lost > > > > > connection after few minutes of normal work. > > > > > I tried restarting network - systemctl restart network.service > > > > > then connection was restored again for few minutes > > > > > > > > > > Finally I could restore connection by restarting iptables - > systemctl > > > > > restart iptables.service > > > > > > > > > > But then again guest VMs lost connection after few minutes of > normal > > > > > operation. > > > > > The time of normal operation can be 5 minutes, but sometimes up t= o > 40 > > > > > minutes. > > > > > > > > > > Please help me to track the root cause and fix it > > > > > > > > > > Host OS - Centos 7.5 > > > > > virtualisation - KVM > > > > > > > > > > > > > > > > > > > > > -- > > > > Daan > > > > > > > > > > > > > -- > Daan > --=20 Andrija Pani=C4=87 --000000000000452ca905716c762b--