hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wilfred Spiegelenburg (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties
Date Thu, 30 Nov 2017 23:53:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16273680#comment-16273680
] 

Wilfred Spiegelenburg commented on YARN-7556:
---------------------------------------------

[~daniel@cloudera.com] the patch looks fine, some questions about how we handle configuration
values and docs:
* we do not document the new resource specification anywhere, how do I know how to configure
the FS, i.e. how do I know that I need to use _memory-mb_ for memory etc.
* do we not allow % settings in the new configuration. It looks like I can not do something
like this:
{code} <minResources>vcores=20%, memory-mb=100, test1=4</minResources> {code}
that breaks the parsing as far as I can tell, is that not allowed or is that an oversight?
* there is a change in behaviour between the old and new configurations: we used to allow
floats for MB and vcore values. We even use that in the tests. The new config does not allow
that. This also impacts the percentages for these resources.


> Fair scheduler configuration should allow resource types in the minResources and maxResources
properties
> --------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-7556
>                 URL: https://issues.apache.org/jira/browse/YARN-7556
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: fairscheduler
>    Affects Versions: 3.0.0-beta1
>            Reporter: Daniel Templeton
>            Assignee: Daniel Templeton
>            Priority: Critical
>         Attachments: YARN-7556.001.patch, YARN-7556.002.patch, YARN-7556.003.patch, YARN-7556.004.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message