Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EDF8718A92 for ; Thu, 12 Nov 2015 13:05:13 +0000 (UTC) Received: (qmail 23547 invoked by uid 500); 12 Nov 2015 13:05:08 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 23486 invoked by uid 500); 12 Nov 2015 13:05:08 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 23473 invoked by uid 99); 12 Nov 2015 13:05:08 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Nov 2015 13:05:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id CA7B418098E for ; Thu, 12 Nov 2015 13:05:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.88 X-Spam-Level: ** X-Spam-Status: No, score=2.88 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Clg8t8Qn66HY for ; Thu, 12 Nov 2015 13:05:00 +0000 (UTC) Received: from mail-lf0-f49.google.com (mail-lf0-f49.google.com [209.85.215.49]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 8955421277 for ; Thu, 12 Nov 2015 13:04:59 +0000 (UTC) Received: by lfs39 with SMTP id 39so33520488lfs.3 for ; Thu, 12 Nov 2015 05:04:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-type; bh=e0rbEI8w+U6UbcYJ4WJ0gxDX7sA2iERFOFec6GqHtX4=; b=ro5q0UMwWjey3jwKuAPy7gkBvB6FLCyBRUIjiDomjjp/3PkoukgCn2fU8vZDLTHvRD TngoIaNel+oXTVXngK/8qeGH36xTfKjMplqdNxRY1R8KqhcNiPoPB4n0uD7c6U6l0Hve 5Q0ewqNYb4BEz4CQ5k6ksrCik3eBgaz6g7P3gtpYR6oQipxKd/F/Oi0A5N82CBygDzC+ g9AZN6AMOZNc3pWCO8ih9tjfaC/2+6fB/oXQ/LGAwfu78K+XuyoCB60vn/om3N66eWJ6 iC6TujgiT1+hUzqDOUJdcXUVOoUfkU56kJBJGU3FJDIQftUFtN2zb+4DxYNnL3Ggbm1x LZaQ== X-Received: by 10.25.21.70 with SMTP id l67mr6957251lfi.27.1447333498888; Thu, 12 Nov 2015 05:04:58 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?Q?Gyula_F=C3=B3ra?= Date: Thu, 12 Nov 2015 13:04:49 +0000 Message-ID: Subject: Re: Flink managed memory in cluster mode To: "dev@flink.apache.org" Content-Type: multipart/alternative; boundary=001a11405aea12a9d50524579796 --001a11405aea12a9d50524579796 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks Fabian :) Fabian Hueske ezt =C3=ADrta (id=C5=91pont: 2015. nov. 1= 2., Cs, 14:03): > Hi Gyula, > > I just checked with jconsole that the memory allocation is correct. > However, the log message is a bit misleading. In case of the streaming > mode, the managed memory is lazily allocated and the logged amount is an > upper bound. > > Cheers, Fabian > > 2015-11-12 13:37 GMT+01:00 Gyula F=C3=B3ra : > > > Hey guys, > > > > Is it normal that when I start the cluster with > start-cluster-streaming.sh > > out of the 16gb tm memory 10.6 gb becomes flink managed? (I get pretty > much > > the same number when I use start-cluster.sh) > > > > I thought that Flink would only use a very small fraction in streaming > > mode. > > > > Cheers, > > Gyula > > > --001a11405aea12a9d50524579796--