hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2531) CGroups - Admins should be allowed to enforce strict cpu limits
Date Wed, 17 Sep 2014 13:57:37 GMT

    [ https://issues.apache.org/jira/browse/YARN-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14137262#comment-14137262

Hudson commented on YARN-2531:

FAILURE: Integrated in Hadoop-Hdfs-trunk #1874 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1874/])
YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce
strict control of per-container cpu usage. Contributed by Varun Vasudev. (vinodkv: rev 9f6891d9ef7064d121305ca783eb62586c8aa018)
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/util/CgroupsLCEResourcesHandler.java
* hadoop-yarn-project/CHANGES.txt
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/util/TestCgroupsLCEResourcesHandler.java

> CGroups - Admins should be allowed to enforce strict cpu limits
> ---------------------------------------------------------------
>                 Key: YARN-2531
>                 URL: https://issues.apache.org/jira/browse/YARN-2531
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>             Fix For: 2.6.0
>         Attachments: apache-yarn-2531.0.patch
> From YARN-2440 -
> {quote} 
> The other dimension to this is determinism w.r.t performance. Limiting to allocated cores
overall (as well as per container later) helps orgs run workloads and reason about them deterministically.
One of the examples is benchmarking apps, but deterministic execution is a desired option
beyond benchmarks too.
> {quote}
> It would be nice to have an option to let admins to enforce strict cpu limits for apps
for things like benchmarking, etc. By default this flag should be off so that containers can
use available cpu but admin can turn the flag on to determine worst case performance, etc.

This message was sent by Atlassian JIRA

View raw message