Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6CFD8200C5C for ; Thu, 20 Apr 2017 12:31:56 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 6B759160B9F; Thu, 20 Apr 2017 10:31:56 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 8BA33160B91 for ; Thu, 20 Apr 2017 12:31:55 +0200 (CEST) Received: (qmail 57016 invoked by uid 500); 20 Apr 2017 10:31:54 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 57004 invoked by uid 99); 20 Apr 2017 10:31:54 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Apr 2017 10:31:54 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 169531AF8E6 for ; Thu, 20 Apr 2017 10:31:54 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id gVeZmXEsl6TV for ; Thu, 20 Apr 2017 10:31:52 +0000 (UTC) Received: from mail-wm0-f53.google.com (mail-wm0-f53.google.com [74.125.82.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id D69F35F3BC for ; Thu, 20 Apr 2017 10:31:51 +0000 (UTC) Received: by mail-wm0-f53.google.com with SMTP id o81so99986108wmb.1 for ; Thu, 20 Apr 2017 03:31:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=CRvljA0o+dA3xV7TQdOuWLacItNKODfs4tYPXhpMY+Y=; b=Q3jnas41n16VOOvvGZ1G4rHHHN36FvD+A7RiKcjZ9S+tRK2sA6DWwW5kqko4KxUnDN YCSrLXOXSf2vgVCayTrRocPF6bSNxrvEbK1ayD7QoB3IEikIS1YP9dxoAHiQwtvXBQfB /kZyKJCTfLOrAky4OKZnLtHDu/gZQnitz4LDOCuSWGTqtQ9PBFzIu/QXEWX4fmmTh+CS F3wfupq2tBOkrXwmLBg2E7PtK2kKhJvP+ONoq7Q7DeCx0A7R+wQzEK/j3jZyyquITlz+ uxt05QqK0DHsu4QExq9pfq3cUQJAJ6REMfOWjZXX27PgZ+DtLiO3eJGlAAyQ5vamk9rS 2rpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=CRvljA0o+dA3xV7TQdOuWLacItNKODfs4tYPXhpMY+Y=; b=enSyQ03rTsVRb2nxx2Db5FKPDP7FZGKYzTxFbj/8SHaAvH+hRcA8sqrNoD9VJFeDTk V8gduEDDPvMX67hVKliEqfIBfatoit+xKX6RSpscqrX6yW1jJc9DQ+Ksa+iSzOP8pdl1 m0MMTZI59YZkBtSVNDJX0xVH0vJjfdjLAwNG+rzIE4g63VrDsraFjMY3Knl5gjDAgTYx HpxSwODkfdQ4EYsl4+lYJQL1Cn7EcCmBQ7gkTX+VVmcq/xdHKElz31rcVgb27jmldyEO gy/hSyM+DpqPCMT8FK46c4nbaQNgaIdPK12VVtqK3lgj1uZcADHJDLWXF9yt2rART8+2 XIow== X-Gm-Message-State: AN3rC/6L0wd6Z2SSfspDdmmA1KRybeEr+LDt2euES+dqdPcwLgeejMj/ XJPqPTgZoiw66OTCOadNC6ZzYUiIsKSV X-Received: by 10.28.175.211 with SMTP id y202mr2402933wme.105.1492684310860; Thu, 20 Apr 2017 03:31:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.134.24 with HTTP; Thu, 20 Apr 2017 03:31:10 -0700 (PDT) In-Reply-To: References: <51CE27F0-3225-4085-8D48-6395E56E069F@apache.org> <08A3FB3A-833D-4ABB-A813-66E43927D659@apache.org> <1C2CEC60-EA8C-4A43-84D3-ADDB6561C6B9@apache.org> From: Sergey Chugunov Date: Thu, 20 Apr 2017 13:31:10 +0300 Message-ID: Subject: Re: Page Memory behavior with default memory policy To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary=001a114428a21c6e90054d96a62a archived-at: Thu, 20 Apr 2017 10:31:56 -0000 --001a114428a21c6e90054d96a62a Content-Type: text/plain; charset=UTF-8 yes, we do: IGNITE-5024 On Thu, Apr 20, 2017 at 1:23 PM, Vladimir Ozerov wrote: > Guys, > > Do we have a ticket for this change? > > On Thu, Apr 20, 2017 at 1:13 PM, Alexey Goncharuk < > alexey.goncharuk@gmail.com> wrote: > > > This actually will affect only nodes started in a single jvm, but I agree > > that expandable memory provides better user experience. Let's try to > > squeeze this change to 2.0. > > > > 2017-04-20 12:32 GMT+03:00 Sergi Vladykin : > > > > > Guys, > > > > > > If we have a default of 80% of available memory then just starting few > > > nodes on my laptop will make it hang. This idea does not work until we > > have > > > a dynamically expandable memory pools. > > > > > > Sergi > > > > > > 2017-04-19 22:20 GMT+03:00 Dmitriy Setrakyan : > > > > > > > Sergey, > > > > > > > > I have responded in the ticket. Can you please provide the current > and > > > the > > > > proposed configuration examples? > > > > > > > > D. > > > > > > > > On Wed, Apr 19, 2017 at 2:34 AM, Sergey Chugunov < > > > > sergey.chugunov@gmail.com> > > > > wrote: > > > > > > > > > Guys, > > > > > > > > > > I created a ticket to implement these improvements, please take a > > look: > > > > > IGNITE-5024 > > > > > > > > > > Besides employing the idea of allocation 80% of physical memory I'm > > > also > > > > > suggesting to introduce one more configuration property to specify > > > > default > > > > > MemoryPolicy's size in bytes without having to use verbose syntax > of > > > > > *memoryPolicyConfiguration > > > > > *section. > > > > > > > > > > Any thoughts on this? > > > > > > > > > > Thanks, > > > > > Sergey. > > > > > > > > > > > > > > > > > > > > On Tue, Apr 18, 2017 at 12:12 PM, Dmitriy Setrakyan < > > > > dsetrakyan@apache.org > > > > > > > > > > > wrote: > > > > > > > > > > > On Tue, Apr 18, 2017 at 2:09 AM, Alexey Goncharuk < > > > > > > alexey.goncharuk@gmail.com> wrote: > > > > > > > > > > > > > I don't see why not, this is the way our tests are currently > > > running. > > > > > > > Anyways, we can think about efficient dynamic memory expansion > in > > > > 2.1, > > > > > > this > > > > > > > may be feasible if we free up some space in PageId to encode > > > segment > > > > > > > number. There is a ticket for this: > > > > > > > https://issues.apache.org/jira/browse/IGNITE-4921 > > > > > > > > > > > > > > > > > > Alexey, if the operating system is already handling this for us, > I > > > > don't > > > > > > see a reason to do it manually. > > > > > > > > > > > > I also like what Denis and Semyon are proposing. However, I would > > not > > > > > grab > > > > > > the full free memory. How about 80% of the free memory? > > > > > > > > > > > > D. > > > > > > > > > > > > > > > > > > > > > --001a114428a21c6e90054d96a62a--