From user-return-21366-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Fri Aug 24 13:04:00 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 82E3C180629 for ; Fri, 24 Aug 2018 13:03:59 +0200 (CEST) Received: (qmail 4119 invoked by uid 500); 24 Aug 2018 11:03:58 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 4109 invoked by uid 99); 24 Aug 2018 11:03:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2018 11:03:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 03C761A1976 for ; Fri, 24 Aug 2018 11:03:58 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.869 X-Spam-Level: * X-Spam-Status: No, score=1.869 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id UJPPWzgeI2Pk for ; Fri, 24 Aug 2018 11:03:56 +0000 (UTC) Received: from mail-oi0-f45.google.com (mail-oi0-f45.google.com [209.85.218.45]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 0CEF95F35A for ; Fri, 24 Aug 2018 11:03:56 +0000 (UTC) Received: by mail-oi0-f45.google.com with SMTP id l202-v6so7720612oig.7 for ; Fri, 24 Aug 2018 04:03:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=LjZ3X5oiFAYWBSk5l1JKBcD6uVc57H3ZiSeeWI7Z+JM=; b=UDK4nTJX0WIpp091IrkYpLSxqLf7CY1sv5OIXNZEdVAEBvzKDhYJ1GSiD9FRKOYDMx PGR/7hM2Om4Z6ZYvyQW5990ucjxMVdhj6SHp4cgW8pFW2hUh1o30WkKRvKi0AvGKGNie siSdtgWurAs4Csz7xGYuApcS0dVj3qjYQbuSuaj5AClivjtUenAb/BdmXq+ijaerhmUd JVNWPysUz0+Uquy88PC6Ck7d6CxWAtRq3xhqdrnNcqs8W9Qw6nr51I0G8TicmWJqVzZu tYbE668eiomtNuAQj9IMxmpnjXZ8qpNWMZms0/avW4lPBovMwrfauV/Ez3283ammWtlP 5oyg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=LjZ3X5oiFAYWBSk5l1JKBcD6uVc57H3ZiSeeWI7Z+JM=; b=T9py+L7x33PH9F7iPByTauw1hn+w3vrawu8NjDUNmSh+Mt6wjno9DHM5uvrRu7mMtB KJkXtqWvMDTpR1sob4ebja4o23uPc1FOY8jrcW4fXQaS/akdgTMS6zIjfOYGTUIGdW9M U0FUJCyazmlJVMGB788qjTQV1TnhRJkncpq9fTFHeQkhQ/pse/HXXOABIxzLYv+zFm+J UsR5dj+9fCn63jTDHnbBL0X7sCdz9DzRkXEg0+zEvXdfFuiPGxKVL0vAV5pinZIzXs9V 8HTSjyccTl1rinJxS1NSitoTbQwTLIIF4avgbR+D29yb3qyiWU94FhtNLQEetEWESqP3 ELQA== X-Gm-Message-State: APzg51D7MzwGAg1tD1ND77MPP+MVqSDZfixupWc4NneY05yOSQNbu7fg R1z0AtrtOqLgfBHzvm8jXY/S6OSftXXozutCccncMA== X-Google-Smtp-Source: ANB0VdYt+gYvwrjgFpjY/6GjQuQ+nTWAzdjXh1Y+265g0jQvvi10AtKXIKSK/fLh+inNkNH7aY7otg6eKLouhE622h8= X-Received: by 2002:aca:adc6:: with SMTP id w189-v6mr1053820oie.174.1535108634404; Fri, 24 Aug 2018 04:03:54 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Dmitriy Pavlov Date: Fri, 24 Aug 2018 14:03:45 +0300 Message-ID: Subject: Re: How much heap to allocate To: user@ignite.apache.org Content-Type: multipart/alternative; boundary="000000000000d86f5f05742c547f" --000000000000d86f5f05742c547f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Eugene, Misprint was corrected in https://issues.apache.org/jira/browse/IGNITE-7824= and will be released as part of 2.7. Even you don't have on-heap caches, entries during reading will be anyway unmarshalled from off-heap to on-heap. So right choice of -Xmx has a high dependence to particular application scenario. Sincerely, Dmitriy Pavlov =D1=81=D1=80, 22 =D0=B0=D0=B2=D0=B3. 2018 =D0=B3. =D0=B2 21:30, eugene mire= tsky : > Hi, > > I am getting the following warning when starting Ignite - " > > Nodes started on local machine require more than 20% of physical RAM what > can lead to significant slowdown due to swapping > " > > The 20% is a typo in version 2.5, it should be 80%. > > We have increased the max size of the default region to 70% of the > available memory on the instance (since that's the only region we use at > the moment). > > From reading the code > that > generates the error, it seems like > 1) Ignite adds all the memory across all nodes to check if it is above th= e > safeToUse threshold. I would expect the check to be done per node > 2) totalOffheap seems to be the sum of the maxSizes of all regions, and > totalHeap retrieved from the JVM configs. ingnite.sh sets -Xmx200g. > > Assuming we are not enabling on-heap caching, what should we set the heap > size to? > > Cheers, > Eugene > --000000000000d86f5f05742c547f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Eugene,

Misprint was corrected in=C2= =A0https://is= sues.apache.org/jira/browse/IGNITE-7824=C2=A0and will be released as pa= rt of 2.7.

Even you don't have on-heap caches,= entries during reading will be anyway unmarshalled from off-heap to on-hea= p. So right choice of -Xmx has a high dependence to particular application = scenario.

Sincerely,
Dmitriy Pavlov

=D1=81=D1=80, 22 =D0= =B0=D0=B2=D0=B3. 2018 =D0=B3. =D0=B2 21:30, eugene miretsky <eugene.miretsky@gmail.com>:
Hi,

I= am getting the following=C2=A0warning when starting Ignite - " =

Nodes started on local machine require more than 20% of physica= l RAM what can lead to significant slowdown due to swapping

"= ;

The 20% is a typo in version 2.5, it should be= 80%. =C2=A0

We have increas= ed the max size of the default region to 70% of the available=C2=A0memory o= n the instance (since that's the only region we use at the moment).=C2= =A0

From reading t= he=C2=A0code=C2=A0that generates the error, it seems like= =C2=A0=C2=A0
1) Ignite adds all the memory across= all nodes to check if it is above the safeToUse=C2=A0threshold. I would ex= pect the check=C2=A0to be done per node
2) totalOffheap = seems to be the sum of the maxSizes of all regions, and totalHeap=C2=A0retr= ieved from the JVM configs. ingnite.sh sets=C2=A0 -Xmx200g.= =C2=A0

Assuming we are not enabling on-heap caching, wha= t should we set the heap size to?=C2=A0

Cheers,
Eugene
--000000000000d86f5f05742c547f--