hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9200) Enable resource configuration of queue capacity for different resources independently
Date Tue, 15 Jan 2019 00:50:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-9200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742626#comment-16742626
] 

Aihua Xu commented on YARN-9200:
--------------------------------

[~wangda], [~sunilg],  [~cheersyang] Want to hear your thoughts. Would that improvement work?


> Enable resource configuration of queue capacity for different resources independently
> -------------------------------------------------------------------------------------
>
>                 Key: YARN-9200
>                 URL: https://issues.apache.org/jira/browse/YARN-9200
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacity scheduler
>    Affects Versions: 3.1.0
>            Reporter: Aihua Xu
>            Priority: Major
>
> In capacity scheduler, currently two resource allocations are supported. 1. percentage
allocation for child queues -  the child queue gets a defined percentage of the resources
for all the resource types; 2. absolute values  (YARN-5881) - each resource is configured
an absolute values.
> Right now we can't mix these case together and it would also very confusing to mix them
in one cluster. The second case actually is more targeting toward cloud env. 
> In a non-cloud env, the ability to configure each resource independently is also useful,
but in such env, percentage is preferable instead of absolute value. One thought here is to
add the percentage configuration for each resource type on the queue. That would allow us
to configure memory bounded queues, or CPU bounded queues. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message