Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 64405200D4E for ; Thu, 7 Dec 2017 13:54:24 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 63027160C0C; Thu, 7 Dec 2017 12:54:24 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id AB607160BFE for ; Thu, 7 Dec 2017 13:54:23 +0100 (CET) Received: (qmail 1609 invoked by uid 500); 7 Dec 2017 12:54:22 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 1589 invoked by uid 99); 7 Dec 2017 12:54:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Dec 2017 12:54:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 9243FC761F for ; Thu, 7 Dec 2017 12:54:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.831 X-Spam-Level: X-Spam-Status: No, score=-0.831 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=citi.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 2TUkmeLR6tXb for ; Thu, 7 Dec 2017 12:54:20 +0000 (UTC) Received: from mx0b-00123c02.pphosted.com (mx-b.mail.citi.com [67.231.153.94]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id D85265FB3A for ; Thu, 7 Dec 2017 12:54:19 +0000 (UTC) Received: from pps.filterd (m0127373.ppops.net [127.0.0.1]) by mx0a-00123c02.pphosted.com (8.16.0.21/8.16.0.21) with SMTP id vB7CkUJH173035 for ; Thu, 7 Dec 2017 12:54:13 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=citi.com; h=from : to : subject : date : message-id : content-type : content-transfer-encoding : mime-version; s=maila; bh=5AYIsHaOgEVIyRPs6+9PHWTr2zTU+nyeofUFdmo4gwM=; b=sLDjp/iSs2Ph1ipzDY/44EU7Q3WjVDxoN2XH5gZcM/pA7YdSkEyriu9FDTGepFtIj7z5 8OW8h/qRsvb30xT9BatD/DG9MjRIgg7HU8vTm9GIZsj6VYkHh4/7E26p5g0TCRB1uJLo hXm0nMDQJggf2ospYSTkk9Zpz10tf38TxAl+6k77/BNgMEx3S1mOROljL0lrIWeO3kgl J1qo+uNc1GU2nqbfq21H7bGQQk99X7WIkQc7NXYuSXJS0TQsJnIgor/HOkyrTDWvFBg5 8f1ffS1v1OTceKLjh4RQFwYmRNtQnCXDqimu9rgAB3A/w5tVXWt5Y3EHII7dp3HxL6bF fA== Received: from mail.citigroup.com (smtpoutbound.citigroup.com [192.193.222.17]) by mx0a-00123c02.pphosted.com with ESMTP id 2ekmfga69k-1 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=NOT) for ; Thu, 07 Dec 2017 12:54:13 +0000 Received: from imbhub-mw35.nam.nsroot.net (imbhub-mw35.nam.nsroot.net [144.215.196.153]) by smtpinbound.citigroup.com (Sentrion-MTA-4.3.1/Sentrion-MTA-4.2.2) with ESMTP id vB7CsCS2009485 for ; Thu, 7 Dec 2017 12:54:12 GMT Received: from imbdlprt-gt03.nam.nsroot.net (imbdlprt-gt03.nam.nsroot.net [153.40.239.192]) by imbhub-mw35.nam.nsroot.net (Sentrion-MTA-4.3.1/Sentrion-MTA-4.2.2) with ESMTP id vB7CsCWW017348 for ; Thu, 7 Dec 2017 12:54:12 GMT Received: from imbdlpbuf-ru01.nam.nsroot.net (namdlpdimpnj14.nam.nsroot.net [150.110.78.141]) by imbdlprt-gt03.nam.nsroot.net (Sentrion-MTA-4.3.1/Sentrion-MTA-4.2.2) with ESMTP id vB7Crglo020586 for ; Thu, 7 Dec 2017 12:54:12 GMT Received: from EXLNIHT10.eur.nsroot.net (EXLNIHT10.eur.nsroot.net [169.182.85.60]) by imbdlpbuf-ru01.nam.nsroot.net (Sentrion-MTA-4.3.1/Sentrion-MTA-4.2.2) with ESMTP id vB7CsAMB001788 for ; Thu, 7 Dec 2017 12:54:10 GMT Received: from EXLNMB58.eur.nsroot.net ([169.254.2.5]) by EXLNIHT10.eur.nsroot.net ([169.182.85.60]) with mapi id 14.03.0361.001; Thu, 7 Dec 2017 12:53:35 +0000 From: "Marchant, Hayden " To: "user@flink.apache.org" Subject: Hardware Reference Architecture Thread-Topic: Hardware Reference Architecture Thread-Index: AdNvWaByoiPy8G5HTiORDn/nY18t0A== Date: Thu, 7 Dec 2017 12:53:35 +0000 Message-ID: <99B8991EBC5DF841B18C71E56C02D4A010D2AD8E@EXLNMB58.eur.nsroot.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [169.182.87.208] x-wiganss: 01000000010018EXLNIHT10.eur.nsroot.net ID0042<99B8991EBC5DF841B18C71E56C02D4A010D2AD8E@EXLNMB58.eur.nsroot.net> Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-12-07_04:,, signatures=0 archived-at: Thu, 07 Dec 2017 12:54:24 -0000 Hi, I'm looking for guidelines for Reference architecture for Hardware for a sm= all/medium Flink cluster - we'll be installing on in-house bare-metal serve= rs. I'm looking for guidance for: 1. Number and spec of CPUs 2. RAM 3. Disks 4. Network 5. Proximity of servers to each other (Most likely, we will choose YARN as a cluster manager for Flink) If someone can share a document or link with relevant information, I will b= e very grateful. Thanks, Hayden Marchant