Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AA336D375 for ; Wed, 29 Aug 2012 00:18:07 +0000 (UTC) Received: (qmail 66246 invoked by uid 500); 29 Aug 2012 00:18:07 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 66218 invoked by uid 500); 29 Aug 2012 00:18:07 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 66205 invoked by uid 99); 29 Aug 2012 00:18:07 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Aug 2012 00:18:07 +0000 Date: Wed, 29 Aug 2012 11:18:07 +1100 (NCT) From: "Hitesh Shah (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: <1822703317.9595.1346199487485.JavaMail.jiratomcat@arcas> Subject: [jira] [Moved] (YARN-55) YARN needs to properly check the NM,AM memory properties in yarn-site.xml and mapred.xml and report errors accordingly. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-55?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah moved MAPREDUCE-4508 to YARN-55: -------------------------------------------- Tags: (was: YARN, NodeManager) Component/s: (was: nodemanager) (was: resourcemanager) resourcemanager nodemanager Affects Version/s: (was: 2.0.0-alpha) 0.23.3 2.2.0-alpha Key: YARN-55 (was: MAPREDUCE-4508) Project: Hadoop YARN (was: Hadoop Map/Reduce) > YARN needs to properly check the NM,AM memory properties in yarn-site.xml and mapred.xml and report errors accordingly. > ----------------------------------------------------------------------------------------------------------------------- > > Key: YARN-55 > URL: https://issues.apache.org/jira/browse/YARN-55 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager, resourcemanager > Affects Versions: 2.2.0-alpha, 0.23.3 > Environment: CentOs6.0, Hadoop2.0.0 Alpha > Reporter: Anil Gupta > Labels: Map, Reduce, YARN > > Please refer to this discussion on the Hadoop Mailing list: > http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/33110 > Summary: > I was running YARN(Hadoop2.0.0 Alpha) on a 8 datanode, 4 admin node Hadoop/HBase cluster. My datanodes were only having 3.2GB of memory. So, i configured the yarn.nodemanager.resource.memory-mb property in yarn-site.xml to 1200. After setting the property if i run any Yarn Job then the NodemManager wont be able to start any Map task since by default the yarn.app.mapreduce.am.resource.mb property is set to 1500 MB in mapred-site.xml. > Expected Behavior: NodeManager should give an error if yarn.app.mapreduce.am.resource.mb >= yarn.nodemanager.resource.memory-mb. > Please let me know if more information is required. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira