From mapreduce-issues-return-48701-apmail-hadoop-mapreduce-issues-archive=hadoop.apache.org@hadoop.apache.org Sun Jul 1 04:16:52 2012 Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D97849ECD for ; Sun, 1 Jul 2012 04:16:51 +0000 (UTC) Received: (qmail 58979 invoked by uid 500); 1 Jul 2012 04:16:50 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 58733 invoked by uid 500); 1 Jul 2012 04:16:49 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 58698 invoked by uid 99); 1 Jul 2012 04:16:48 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 01 Jul 2012 04:16:48 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id D7D9514284C for ; Sun, 1 Jul 2012 04:16:46 +0000 (UTC) Date: Sun, 1 Jul 2012 04:16:46 +0000 (UTC) From: "Harsh J (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <1551849735.76203.1341116206885.JavaMail.jiratomcat@issues-vm> In-Reply-To: <480470575.39218.1338898523199.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Updated] (MAPREDUCE-4316) Improve default config values for YARN MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-4316: ------------------------------- Attachment: MAPREDUCE-4316.patch Right, but MR provides its own set of default resource requests for both AM and Task containers, none of which changed from what they were. So for Trevor's issue at http://s.apache.org/avd, I doubt if the issue were the low min-alloc as you say. Or am I still mistaken and the min-alloc is an enforcer somehow (meaning, MR AM is broken in requesting proper resources?). However, you're right that it affects other apps that would not make an explicit request for a specific value, and, here's a patch that bumps it to 512 MB for min-alloc. > Improve default config values for YARN > -------------------------------------- > > Key: MAPREDUCE-4316 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4316 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: resourcemanager, scheduler > Affects Versions: 2.0.0-alpha > Reporter: Arun C Murthy > Labels: performance > Attachments: MAPREDUCE-4316.patch > > > Currently some of our configs are way off e.g. min-alloc is 128M while max-alloc is 10240. > This leads to poor out-of-box performance as noticed by some users: http://s.apache.org/avd -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira