hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-4316) Improve default config values for YARN
Date Sun, 01 Jul 2012 04:16:46 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Harsh J updated MAPREDUCE-4316:
-------------------------------

    Attachment: MAPREDUCE-4316.patch

Right, but MR provides its own set of default resource requests for both AM and Task containers,
none of which changed from what they were. So for Trevor's issue at http://s.apache.org/avd,
I doubt if the issue were the low min-alloc as you say. Or am I still mistaken and the min-alloc
is an enforcer somehow (meaning, MR AM is broken in requesting proper resources?).

However, you're right that it affects other apps that would not make an explicit request for
a specific value, and, here's a patch that bumps it to 512 MB for min-alloc.
                
> Improve default config values for YARN
> --------------------------------------
>
>                 Key: MAPREDUCE-4316
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4316
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: resourcemanager, scheduler
>    Affects Versions: 2.0.0-alpha
>            Reporter: Arun C Murthy
>              Labels: performance
>         Attachments: MAPREDUCE-4316.patch
>
>
> Currently some of our configs are way off e.g. min-alloc is 128M while max-alloc is 10240.
> This leads to poor out-of-box performance as noticed by some users: http://s.apache.org/avd

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message