hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources
Date Thu, 13 Apr 2017 18:36:41 GMT

    [ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968035#comment-15968035
] 

Wangda Tan commented on YARN-5881:
----------------------------------

[~sunilg],

For the configurations of the absolute min/max resource, I suggest to make it to be more compacted,
for example:
{code}
${queue-path}.min/max-resource = <memory=10G,vcores=2,disk=1G> 
{code}

And in the future we can support per-resource-type capacities in percentage as well: 
{code}
${queue-path}.(maximum-)capacity = <memory=70,vcores=30>
{code} 

To me this will be better than flatten all resource types in your prototype patch.

Thoughts? 

> Enable configuration of queue capacity in terms of absolute resources
> ---------------------------------------------------------------------
>
>                 Key: YARN-5881
>                 URL: https://issues.apache.org/jira/browse/YARN-5881
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Sean Po
>            Assignee: Wangda Tan
>         Attachments: YARN-5881.Support.Absolute.Min.Max.Resource.In.Capacity.Scheduler.design-doc.v1.pdf
>
>
> Currently, Yarn RM supports the configuration of queue capacity in terms of a proportion
to cluster capacity. In the context of Yarn being used as a public cloud service, it makes
more sense if queues can be configured absolutely. This will allow administrators to set usage
limits more concretely and simplify customer expectations for cluster allocation.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message