hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
Date Wed, 03 Oct 2012 02:00:07 GMT

    [ https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13468257#comment-13468257
] 

Arun C Murthy edited comment on YARN-140 at 10/3/12 12:58 PM:
--------------------------------------------------------------

Again, the notion of capacity-scheduler-default.xml overridden by capacity-scheduler-site.xml
_does not_ make sense for CapacityScheduler - this has been the case for a *very long* time.


-1 for *-default.xml + *-site.xml for the CS.

A simpler 'fix' for the problem at hand is to hard-code root capacity to 100, and provide
sane defaults in code for the rest.
                
      was (Author: acmurthy):
    Again, the notion of *-default.xml overridden by *-site.xml *does not* make sense for
CapacityScheduler - this has been the case for a *very long* time. -1 for *-default.xml +
*-site.xml for the CS.

A simpler 'fix' for the problem at hand is to hard-code root capacity to 100, and provide
sane defaults in code for the rest.
                  
> Add capacity-scheduler-default.xml to provide a default set of configurations for the
capacity scheduler.
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-140
>                 URL: https://issues.apache.org/jira/browse/YARN-140
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacityscheduler
>            Reporter: Ahmed Radwan
>            Assignee: Ahmed Radwan
>         Attachments: YARN-140.patch
>
>
> When setting up the capacity scheduler users are faced with problems like:
> {code}
> FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
> java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
> {code}
> Which basically arises from missing basic configurations, which in many cases, there
is no need to explicitly provide, and a default configuration will be sufficient. For example,
to address the error above, the user need to add a capacity of 100 to the root queue.
> So, we need to add a capacity-scheduler-default.xml, this will be helpful to provide
the basic set of default configurations required to run the capacity scheduler. The user can
still override existing configurations or provide new ones in capacity-scheduler.xml. This
is similar to *-default.xml vs *-site.xml for yarn, core, mapred, hdfs, etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message