Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4CFB018A89 for ; Thu, 12 Nov 2015 13:03:30 +0000 (UTC) Received: (qmail 20718 invoked by uid 500); 12 Nov 2015 13:03:30 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 20658 invoked by uid 500); 12 Nov 2015 13:03:30 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 20646 invoked by uid 99); 12 Nov 2015 13:03:29 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Nov 2015 13:03:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 526C01A3290 for ; Thu, 12 Nov 2015 13:03:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.88 X-Spam-Level: ** X-Spam-Status: No, score=2.88 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id fy1CJpnyPic6 for ; Thu, 12 Nov 2015 13:03:23 +0000 (UTC) Received: from mail-lf0-f46.google.com (mail-lf0-f46.google.com [209.85.215.46]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 6905920384 for ; Thu, 12 Nov 2015 13:03:22 +0000 (UTC) Received: by lfdo63 with SMTP id o63so33434799lfd.2 for ; Thu, 12 Nov 2015 05:03:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=bdmmCpqHjGR48tka9Ob6M3XAdlkiaj+2AUFFYqefuKk=; b=XUJzkvfzrNyKT7Zg6cy7Jhu6autsv+bjGCQ3XOGTaGY/ogZTN2GWuZxVxf4gn3L0Y2 29GgysgoEA1SV6PeGacavDlaM1Sy6oIr9wGNT4Z1lo/hE59HrNcbtYyWuI+7BkywxdWu V29sW8XYXkivJCN6J6B7lxOHr/98aC9PaX8GF6xmFM8TlL6nzdjEy6YgekZGAe7lZ4Jf ayd+yazWFcOSzSrpcpFd38GroDKlKICvlVG1T5tCkTN1chTfYu80hRlUXNguNEm8okKe O7c8Kb5MierAcqUdggO1NTZj4q1x+Ym3nlFFUCI724XRK+hLDFIKO1vhsh6aGFNp4kws pKCg== X-Received: by 10.25.160.213 with SMTP id j204mr6937399lfe.85.1447333400667; Thu, 12 Nov 2015 05:03:20 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.160.162 with HTTP; Thu, 12 Nov 2015 05:02:51 -0800 (PST) In-Reply-To: References: From: Fabian Hueske Date: Thu, 12 Nov 2015 14:02:51 +0100 Message-ID: Subject: Re: Flink managed memory in cluster mode To: "dev@flink.apache.org" Content-Type: multipart/alternative; boundary=001a114123c237ec940524579100 --001a114123c237ec940524579100 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Gyula, I just checked with jconsole that the memory allocation is correct. However, the log message is a bit misleading. In case of the streaming mode, the managed memory is lazily allocated and the logged amount is an upper bound. Cheers, Fabian 2015-11-12 13:37 GMT+01:00 Gyula F=C3=B3ra : > Hey guys, > > Is it normal that when I start the cluster with start-cluster-streaming.s= h > out of the 16gb tm memory 10.6 gb becomes flink managed? (I get pretty mu= ch > the same number when I use start-cluster.sh) > > I thought that Flink would only use a very small fraction in streaming > mode. > > Cheers, > Gyula > --001a114123c237ec940524579100--