hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bibin A Chundatt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups
Date Tue, 08 Nov 2016 06:13:59 GMT

    [ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646642#comment-15646642
] 

Bibin A Chundatt commented on YARN-5849:
----------------------------------------

Thank you [~miklos.szegedi@cloudera.com] for patch 

Patch helps in debugging with detailed logging.

# As per  current implementation we do  we support 'deferred' mounting of specific controllers.But
when enable mount is false we try to create {{cGroupPrefix}} for all {{CGroupController}}.
# {{if (!FileUtil.canWrite(yarnHierarchy))}} check should be in else case rt? 


> Automatically create YARN control group for pre-mounted cgroups
> ---------------------------------------------------------------
>
>                 Key: YARN-5849
>                 URL: https://issues.apache.org/jira/browse/YARN-5849
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 2.7.3, 3.0.0-alpha1, 3.0.0-alpha2
>            Reporter: Miklos Szegedi
>            Assignee: Miklos Szegedi
>            Priority: Minor
>         Attachments: YARN-5849.000.patch, YARN-5849.001.patch
>
>
> Yarn can be launched with linux-container-executor.cgroups.mount set to false. It will
search for the cgroup mount paths set up by the administrator parsing the /etc/mtab file.
You can also specify resource.percentage-physical-cpu-limit to limit the CPU resources assigned
to containers.
> linux-container-executor.cgroups.hierarchy is the root of the settings of all YARN containers.
If this is specified but not created YARN will fail at startup:
> Caused by: java.io.FileNotFoundException: /cgroups/cpu/hadoop-yarn/cpu.cfs_period_us
(Permission denied)
> org.apache.hadoop.yarn.server.nodemanager.util.CgroupsLCEResourcesHandler.updateCgroup(CgroupsLCEResourcesHandler.java:263)
> This JIRA is about automatically creating YARN control group in the case above. It reduces
the cost of administration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message