hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2531) CGroups - Admins should be allowed to enforce strict cpu limits
Date Tue, 16 Sep 2014 17:10:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135742#comment-14135742

Vinod Kumar Vavilapalli commented on YARN-2531:

This looks good to me. The test was a little hard to track given the many knobs, but I understand
it now. So, we now have {{yarn.nodemanger.linux-container-executor.cgroups.strict-resource-usage}}
- a boolean for admins to override app-configs and enforce/not-enforce strict controls.

+1, checking this in.

> CGroups - Admins should be allowed to enforce strict cpu limits
> ---------------------------------------------------------------
>                 Key: YARN-2531
>                 URL: https://issues.apache.org/jira/browse/YARN-2531
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: apache-yarn-2531.0.patch
> From YARN-2440 -
> {quote} 
> The other dimension to this is determinism w.r.t performance. Limiting to allocated cores
overall (as well as per container later) helps orgs run workloads and reason about them deterministically.
One of the examples is benchmarking apps, but deterministic execution is a desired option
beyond benchmarks too.
> {quote}
> It would be nice to have an option to let admins to enforce strict cpu limits for apps
for things like benchmarking, etc. By default this flag should be off so that containers can
use available cpu but admin can turn the flag on to determine worst case performance, etc.

This message was sent by Atlassian JIRA

View raw message