Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C000A18FD7 for ; Thu, 14 Jan 2016 00:13:53 +0000 (UTC) Received: (qmail 77864 invoked by uid 500); 14 Jan 2016 00:13:48 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 77775 invoked by uid 500); 14 Jan 2016 00:13:48 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 77762 invoked by uid 99); 14 Jan 2016 00:13:48 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Jan 2016 00:13:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DA0D31A07D6 for ; Thu, 14 Jan 2016 00:13:47 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.001 X-Spam-Level: *** X-Spam-Status: No, score=3.001 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id K1Z882fDBYaW for ; Thu, 14 Jan 2016 00:13:37 +0000 (UTC) Received: from BAY004-OMC2S18.hotmail.com (bay004-omc2s18.hotmail.com [65.54.190.93]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 74C97206A7 for ; Thu, 14 Jan 2016 00:13:37 +0000 (UTC) Received: from BAY176-DS17 ([65.54.190.123]) by BAY004-OMC2S18.hotmail.com over TLS secured channel with Microsoft SMTPSVC(7.5.7601.23008); Wed, 13 Jan 2016 16:13:31 -0800 X-TMN: [hq3ToPGKz1eiXxumkEdKkRGXAHvFhqoJ] X-Originating-Email: [yaoxiaohua@outlook.com] Message-ID: From: yaoxiaohua To: Subject: Determine HDP Memory Configuration Settings Date: Thu, 14 Jan 2016 08:13:15 +0800 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_001E_01D14EA3.6B83CA90" X-Mailer: Microsoft Outlook 14.0 Thread-Index: AdFOXpwJfvs2tsfYQneobkbEBM+uuA== Content-Language: zh-cn X-OriginalArrivalTime: 14 Jan 2016 00:13:31.0168 (UTC) FILETIME=[665D6A00:01D14E60] ------=_NextPart_000_001E_01D14EA3.6B83CA90 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, When we configure memory in yarn-site.xml, we find a recommend in hortonworks website. Determine HDP Memory Configuration Settings http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manual ly_book/content/determine-hdp-memory-config.html python yarn-utils.py -c 16 -m 64 -d 4 -k True my question is that, for first parameter is the -c CORES The number of cores on each host. How to calculate the number of cores on each host? Use nproc? Or other tools? I know that our host's physical cores is 8, logical cores is 32. I should use which number? 32 or 8? Best Regards, Evan Yao ------=_NextPart_000_001E_01D14EA3.6B83CA90 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

&= nbsp; When we configure memory in = yarn-site.xml, we find a recommend in hortonworks = website.

Determine HDP Memory Configuration = Settings

http://docs.hortonworks.com/HDPDocuments/HDP= 2/HDP-2.3.0/bk_installing_manually_book/content/determine-hdp-memory-conf= ig.html

       python yarn-utils.py -c 16 -m 64 -d =
4 -k True

&= nbsp;

&= nbsp; my question is that, for first = parameter is the

-c = CORES

The number of = cores on each host.

&= nbsp; How to calculate the number of cores = on each host?

&= nbsp; Use nproc? Or other = tools?

&= nbsp; I know that our host’s = physical cores is 8, logical cores is 32.

&= nbsp; I should use which number? 32 or = 8?

Best Regards,

Evan = Yao

------=_NextPart_000_001E_01D14EA3.6B83CA90--