Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DAF6F189FD for ; Thu, 28 Apr 2016 21:18:43 +0000 (UTC) Received: (qmail 39716 invoked by uid 500); 28 Apr 2016 21:18:43 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 39653 invoked by uid 500); 28 Apr 2016 21:18:43 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 39641 invoked by uid 99); 28 Apr 2016 21:18:43 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Apr 2016 21:18:43 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id C7601C790B for ; Thu, 28 Apr 2016 21:18:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.299 X-Spam-Level: * X-Spam-Status: No, score=1.299 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=greghogan-com.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Wpmis4uC3J7w for ; Thu, 28 Apr 2016 21:18:41 +0000 (UTC) Received: from mail-io0-f179.google.com (mail-io0-f179.google.com [209.85.223.179]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id C1E025F297 for ; Thu, 28 Apr 2016 21:18:40 +0000 (UTC) Received: by mail-io0-f179.google.com with SMTP id d62so90150550iof.2 for ; Thu, 28 Apr 2016 14:18:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=greghogan-com.20150623.gappssmtp.com; s=20150623; h=mime-version:date:message-id:subject:from:to; bh=xJhwDJtPmMbceqSqoQkCxiV9kHNmKmyNl0VAT7BkfaU=; b=sm5FfztXYN898MLcqPCXiJCyesW9gtJoxOByXeikFabgeXeZtubYzhKRRE4funjYzL ghkQ4LXgiwEo3XZB/Ka4InSOOjeeN1OLz0/wdZjKpIC+wrZb73mcDZ+baYvCSMzNcURt pe8/d7VCzWp2TKtAkZDYazW84Tm4Nig3VIySbxMjmLC7Lih9hFNnVoK6QS3IUYwE7cSC clq7mXl0qNKDOhU4HLQrFt5tkc8rS9xKPtX5sqW++4r1ogm0HVRQJ5BbvBP9Tp0Aei7X eUumP6LUmrVmPxZZcHksEaJ5RPG98LXEZ+W1xBTNihDeV9rPEc77u8JbYMLrorGpUTsG JURw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to; bh=xJhwDJtPmMbceqSqoQkCxiV9kHNmKmyNl0VAT7BkfaU=; b=EAXLThH9qw5qjwI0HIESIfPHQ86N+oJBDGlgSWQBNc02HNLl6ZiD6t4DxIXeCPvXii vmqzpw7X3KPGk+YXnv/+8IEzx+O5v7LfLDF7WmL0+ZqIopmOBxFl76vcSmPzSxkpcaIe ZmVyYksmbMXDClJREurGNaz6Tp+kBXSPvhAQvaO4mAn0l32zjzgoYZBMQMLlq8Rxvf5c AZJschXeZFGXs3PpmF/Cew8Tx4gXmWppwVK4H4Z/ap+tAonJEA63iIFaXe8MezRZw9nf +Mf/BKGwp8dI9Kn125GspSXyOOCqFvqKVRvrKO7M8kpGokZksobK5eYlcXUHoZx3m0Qr +YJA== X-Gm-Message-State: AOPr4FXPNXjfw6by+4q32QYZVQemj/4I6Obkcqe9knSuuuaaBbiftq6LdYuzECr1jkEvYFPbW3VFfvc8apeOIQ== MIME-Version: 1.0 X-Received: by 10.107.63.214 with SMTP id m205mr20917570ioa.15.1461878319636; Thu, 28 Apr 2016 14:18:39 -0700 (PDT) Received: by 10.64.224.133 with HTTP; Thu, 28 Apr 2016 14:18:39 -0700 (PDT) X-Originating-IP: [144.51.242.14] Date: Thu, 28 Apr 2016 17:18:39 -0400 Message-ID: Subject: taskmanager.heap.mb recommendation From: Greg Hogan To: dev@flink.apache.org Content-Type: multipart/alternative; boundary=94eb2c062a4cf27ed2053192110a --94eb2c062a4cf27ed2053192110a Content-Type: text/plain; charset=UTF-8 Hi all, The Flink docs recommend "if the cluster is exclusively running Flink, the total amount of available memory per machine minus some memory for the operating system (maybe 1-2 GB) is a good value" [1]. Would it be worthwhile to recommend a higher memory reserve and note that the file write and read-ahead caches must also fit in memory? [1] https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html Greg --94eb2c062a4cf27ed2053192110a--