hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhaohui Xin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-9045) Container's cpu usage limit should be soft with a relaxation factor
Date Thu, 22 Nov 2018 02:47:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhaohui Xin updated YARN-9045:
------------------------------
    Attachment: YARN-9045.001.patch
                YARN-9045.002.patch

> Container's cpu usage limit should be soft with a relaxation factor
> -------------------------------------------------------------------
>
>                 Key: YARN-9045
>                 URL: https://issues.apache.org/jira/browse/YARN-9045
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.6.0, 3.1.1
>            Reporter: Zhaohui Xin
>            Assignee: Zhaohui Xin
>            Priority: Major
>         Attachments: YARN-9045.001.patch, YARN-9045.002.patch, shared_mode.png, strict_mode.png,
strict_relax_mode.png
>
>
> There are two modes in yarn container cpu limitation. The default is Shared mode which
guarantees the requested resource and can also use other spare CPU if available. Another one
is Strict mode, container's resource is limited to allocated resource strictly.
> If we want to limit the resource usage of the container and can use a certain percentage
of spare CPU if available, the above two modes cannot satisfy our demand. We can define a
relax coefficient(yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage.ratio)
to relax the restrictions on resources in strict mode.
>  
>  Attachments are different modes comparison. Especifically, the last picture is the maximum
percentage of container using CPU when the relaxation coefficient is 1.5.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message