Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id EB0BD200D00 for ; Sun, 10 Sep 2017 08:37:28 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id E9AC51609C3; Sun, 10 Sep 2017 06:37:28 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3A8AC1609BF for ; Sun, 10 Sep 2017 08:37:28 +0200 (CEST) Received: (qmail 72034 invoked by uid 500); 10 Sep 2017 06:37:25 -0000 Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list dev@cloudstack.apache.org Received: (qmail 72012 invoked by uid 99); 10 Sep 2017 06:37:25 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 10 Sep 2017 06:37:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id A954CD1949 for ; Sun, 10 Sep 2017 06:37:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.479 X-Spam-Level: ** X-Spam-Status: No, score=2.479 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=bw-sw-com.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id dwsBXx152f_j for ; Sun, 10 Sep 2017 06:37:23 +0000 (UTC) Received: from mail-it0-f41.google.com (mail-it0-f41.google.com [209.85.214.41]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E39825FDB8 for ; Sun, 10 Sep 2017 06:37:22 +0000 (UTC) Received: by mail-it0-f41.google.com with SMTP id r131so3122295itc.1 for ; Sat, 09 Sep 2017 23:37:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bw-sw-com.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=UsLUaiPXXrW1ICbXvIAqXZAh5TIaeXSD3xVOFsoSY2c=; b=kEIII4Y0KqaK1OjP05jTqA3bYSVZ2ZiSO6l24x8l2GuPw6RyDeZY8oGq8tPhDyx/Hi 6CwascMUtRP5b6kLkGKjimiMEladXIOxIIhilpL9OoQib7+ECThAPfz8vYnw3AbOdD+y Sf9E7WHODAHHRaktqEWRFXB83dTyYs/XwCwLrcX94r4iLLldVj3lIqxXOFD+9Ns3HRvg l6tNYYQjnftbSVf0vccFWo9Bj8zU330r3Sv/QSEny358F9NFhag5aVYrjbsaY2t6zgmP UYMp00vDK9AsV4lHAol02VoK4g/fWxkjRhp+bmo1jgYdcEWSU7cQQA8IP2qkDF+Tdd2y 7THg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=UsLUaiPXXrW1ICbXvIAqXZAh5TIaeXSD3xVOFsoSY2c=; b=Fjou4TecLayYOgyg/MiC6eboyjAuVyPUbFTnoEWFMvitptQQAY7khX5QPNYmsL6Vzh jOy2QsYddHcGJmSVN6IeLlAcrDsGCOGpbOHM1JTNvJyFecD6wcz6NqukVVTdVHjGjWU9 58d7P99jeumvqzf54YAgra5WDeot5dqm2CERurqYWNF6KPxBmBHOiPmSBe94fh1hi5Yg rUFzVl3otOV8KIWKAFzbFeAfr6NAVyZoaEReQx4DfGVscheuT2FTJaVBB3k/0hQbK2rd SpzsIQY5jHbuO0FM9bKOfozOzmPbBCD9ELxUesg8CA4gVzztvGcNl3rsjyS8KbQ94BCC YdGw== X-Gm-Message-State: AHPjjUgBNglRPKa/5OFxe90j1ioDIyniWgjhyis1Q62y0A55LvQ1cRXM 5WXSZrs/w7Gd+63XCOUSxaKOSWBrmrAMBx5Vug== X-Google-Smtp-Source: AOwi7QA+iQiWe/UMHyONSarEmOCkdR7OFsdJ0+Js6Qq5kGh2x6sEGpbmr1Gk9uTiV5ybtOm7iNn3+dHWP92DDriI4QY= X-Received: by 10.36.14.82 with SMTP id 79mr7215043ite.137.1505025436112; Sat, 09 Sep 2017 23:37:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.50.194 with HTTP; Sat, 9 Sep 2017 23:37:15 -0700 (PDT) From: Ivan Kudryavtsev Date: Sun, 10 Sep 2017 13:37:15 +0700 Message-ID: Subject: KVM Host overprovisioning To: dev@cloudstack.apache.org, users@cloudstack.apache.org Content-Type: multipart/alternative; boundary="001a11437ed07f831a0558d00a0d" archived-at: Sun, 10 Sep 2017 06:37:29 -0000 --001a11437ed07f831a0558d00a0d Content-Type: text/plain; charset="UTF-8" Hello, community. During the last years Linux kernel got some interesting features like KSM, ZSWAP, ZRAM. Hardware also steps forward and we see Intel 3d xpoint, extremely fast SSD drives with m.2 and PCI-E interfaces. These facilities enable potentially interesting use of overcommited RAM for hosts. According to IBM's investigations Zswap with LZ4/ZBUD increases virtual RAM on 40%. I investigated current Apache CloudStack memory overcommitment capabilities and they mostly affect VM's RAM by utilizing ballooning and I think it's not what necessary to open new facilities. There are many cases which can utilize ZSWAP and fast swap devices to efficiently provision more RAM than presents. I suppose, CloudStack Agent for KVM can have configured parameter which "mangles" RAM reported. From the other hand it can be done by implemented host properties on server side. I tried manual increasing in host table: update host set ram=ram * 1.4 where id=1; and it seems until the next host stats update it works as expected. I think this workaround is useful, but it's better to have the function in core like standard. Let me know what you think about it, it might be I don't understand something and ACS already has it in place? I also would like to hear your thoughts on ZSWAP usage in practice. -- With best regards, Ivan Kudryavtsev Bitworks Software, Ltd. Cell: +7-923-414-1515 WWW: http://bitworks.software/ --001a11437ed07f831a0558d00a0d--