hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bibin A Chundatt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups
Date Wed, 09 Nov 2016 05:42:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649880#comment-15649880
] 

Bibin A Chundatt commented on YARN-5849:
----------------------------------------

{quote}
1. The patch applies to the scenario, when enable mount is false. The group is created in
other cases. The current implementation throws an exception if any controller does not have
the group created and writable. What is your more specific concern?
{quote}
IIUC even if the mount patch exists, its not required to create {{yarnHierarchy}} for all
{{CGroupController}} now we can individually configure in {{ResourceHandlerModule}} which
resource chain to use. For example as per current implementation even if yarn is not going
to use memory monitor will create {{yarnHierarchy}} folder . rt??

> Automatically create YARN control group for pre-mounted cgroups
> ---------------------------------------------------------------
>
>                 Key: YARN-5849
>                 URL: https://issues.apache.org/jira/browse/YARN-5849
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 2.7.3, 3.0.0-alpha1, 3.0.0-alpha2
>            Reporter: Miklos Szegedi
>            Assignee: Miklos Szegedi
>            Priority: Minor
>         Attachments: YARN-5849.000.patch, YARN-5849.001.patch
>
>
> Yarn can be launched with linux-container-executor.cgroups.mount set to false. It will
search for the cgroup mount paths set up by the administrator parsing the /etc/mtab file.
You can also specify resource.percentage-physical-cpu-limit to limit the CPU resources assigned
to containers.
> linux-container-executor.cgroups.hierarchy is the root of the settings of all YARN containers.
If this is specified but not created YARN will fail at startup:
> Caused by: java.io.FileNotFoundException: /cgroups/cpu/hadoop-yarn/cpu.cfs_period_us
(Permission denied)
> org.apache.hadoop.yarn.server.nodemanager.util.CgroupsLCEResourcesHandler.updateCgroup(CgroupsLCEResourcesHandler.java:263)
> This JIRA is about automatically creating YARN control group in the case above. It reduces
the cost of administration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message