From dev-return-37917-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Fri Aug 17 09:14:01 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 00FDD18067A for ; Fri, 17 Aug 2018 09:14:00 +0200 (CEST) Received: (qmail 10463 invoked by uid 500); 17 Aug 2018 07:14:00 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 10448 invoked by uid 99); 17 Aug 2018 07:13:59 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Aug 2018 07:13:59 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id EA0131A077F for ; Fri, 17 Aug 2018 07:13:58 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.888 X-Spam-Level: * X-Spam-Status: No, score=1.888 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id q6Oq9Lub11u1 for ; Fri, 17 Aug 2018 07:13:56 +0000 (UTC) Received: from mail-oi0-f48.google.com (mail-oi0-f48.google.com [209.85.218.48]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id ADC745F107 for ; Fri, 17 Aug 2018 07:13:55 +0000 (UTC) Received: by mail-oi0-f48.google.com with SMTP id m11-v6so12486510oic.2 for ; Fri, 17 Aug 2018 00:13:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=laloyshi3tnUNeMmz/ZQqT/JFDiSwQEDFZ5FME7ufKg=; b=Qnwb9pVmPIFgg0Jr3e/JWdU1MbFo9xtKSVkpcct8NoRZHjebfhdlgsa8Gx7OE43eFt +XJTApBawKWBP6lxTiyxZE4D5dfdL1DAaHKDvxoog+1mLhdQPenX3r+U3El6ei5tVGJI /4XbMTjhwT+nvbQwtV1wZIhoeDYH+uKLWK6OgxphNYatxL7VVpzTXP9l2/wvwQouopOq X7TccECTLFjivkVTL8xvurcigKrmtwHNYtWiNWazhHlPsal9ItxMvxD5NoJoG7gSg2r9 1/PvMR3HkkFUBmeynFxskmwOr0bdJN1wsr4s5ULBbR/PvwHUljMq51vTMWqK/ANDGPPL I8xA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=laloyshi3tnUNeMmz/ZQqT/JFDiSwQEDFZ5FME7ufKg=; b=LKHLec2usrAZDRbjdu5q+fQkCoIoW02yPycA6k1uLNTnTuOCQ6wvXrT1+aY5hCuCXF m3duC8LD/Ha+JR/TKcpIikomi6ssHOR9MsdoRxpnIFuWwwf2OdMEsS2CXJ5TozQdsoYd NILDwbtONDrdy11ImDr05v4Wm/2SX3f58E1deIdm7FoItfAJj/mknyHpMGC9CbS3pHKY J9fZy0fUYuJnbqzWoDBYBsXF9cOYykAkakShLi8V6yvrMEVicKSII9wCgLKm5xEwFg4F d2N9m3xUCBzU/Vo3tYM4wlFg9oDeXYt5zujwsifUWix495M5KZ1RQ8CZ2S/K8vvej9xH uvNg== X-Gm-Message-State: AOUpUlEdu10bULmeYLer5iCmDwnn/jUwMgBMRpB9VqsOD1iOHr3/nzPr dVzKP3Uxim/U/eB7l5ugNhR3HV8jOfHaW8zvDLgWHA== X-Google-Smtp-Source: AA+uWPztmICT+/jQbXvg728+eW2Em0yv/nh/AEdn4mIJAmQfo2FM8JV0YlKLutXESMg1GsWZOAx8wboT7nnoIAkNT88= X-Received: by 2002:aca:c514:: with SMTP id v20-v6mr1365197oif.153.1534490034038; Fri, 17 Aug 2018 00:13:54 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Dmitriy Pavlov Date: Fri, 17 Aug 2018 10:13:44 +0300 Message-ID: Subject: Re: Wrong off-heap size is reported for a node To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary="00000000000063eb1b05739c4d9f" --00000000000063eb1b05739c4d9f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Igniters, It is not an easy fix, so I'm not sure it is possible to do in 2.7. Offheap size is not reported by VM (it returns -1). To implement it we need totally migrate off-heap memory metrics to durable memory data. I think this issue was reported and I'll find the duplicate. Sincerely, Dmitriy Pavlov =D0=BF=D1=82, 17 =D0=B0=D0=B2=D0=B3. 2018 =D0=B3. =D0=B2 6:10, Denis Magda = : > Yes, it was at the end of my wordy email :) > https://issues.apache.org/jira/browse/IGNITE-9305 > > -- > Denis > > On Thu, Aug 16, 2018 at 11:03 PM Dmitriy Setrakyan > wrote: > > > Is there a blocker ticket for 2.7? > > > > On Thu, Aug 16, 2018, 19:59 Denis Magda wrote: > > > > > Igniters, > > > > > > Was troubleshooting an Ignite deployment today and couldn't find out > from > > > the logs what was the actual off-heap space used. > > > > > > Those were the given memory resoures (Ignite 2.6): > > > > > > [2018-08-16 15:07:49,961][INFO ][main][GridDiscoveryManager] Topology > > > snapshot [ver=3D1, servers=3D1, clients=3D0, CPUs=3D64, *offheap=3D30= .0GB*, > > > heap=3D24.0GB] > > > > > > And that weird stuff was reported by the node (pay attention to the > last > > > line): > > > > > > [2018-08-16 15:45:50,211][INFO > > > > > > > > > ][grid-timeout-worker-#135%cluster_31-Dec-2017%][IgniteKernal%cluster_31-= Dec-2017] > > > Metrics for local node (to disable set 'metricsLogFrequency' to 0) > > > ^-- Node [id=3Dc033026e, name=3Dcluster_31-Dec-2017, > uptime=3D00:38:00.257] > > > ^-- H/N/C [hosts=3D1, nodes=3D1, CPUs=3D64] > > > ^-- CPU [cur=3D0.03%, avg=3D5.54%, GC=3D0%] > > > ^-- PageMemory [pages=3D6997377] > > > ^-- Heap [used=3D9706MB, free=3D61.18%, comm=3D22384MB] > > > * ^-- Non heap [used=3D144MB, free=3D-1%, comm=3D148MB] - this lin= e is > > always > > > the same!* > > > > > > Had to change the code by using dataRegion.getPhysicalMemoryPages() t= o > > find > > > out that actual off-heap usage size was > > > >>> Physical Memory Size: 28651614208 =3D> 27324 MB, 26 GB > > > > > > Let's fix this issue in 2.7, I proposed a new format. Please review a= nd > > > share your thoughts: > > > https://issues.apache.org/jira/browse/IGNITE-9305 > > > > > > -- > > > Denis > > > > > > --00000000000063eb1b05739c4d9f--