hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jun Gong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4382) Container hierarchy in cgroup may remain for ever after the container have be terminated
Date Wed, 16 Nov 2016 12:28:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670310#comment-15670310

Jun Gong commented on YARN-4382:

You want to write the shell command or the script to release_agent in the cgroup ? The Shell
command or the script that can delete the hierarchy or the container empty dirs.
Yes. The demo could be found at https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Resource_Management_Guide/sec-common_tunable_parameters.html.

Please feel free to work on it. Sorry for it. I was busy at that time and forgot it...:(

> Container hierarchy in cgroup may remain for ever after the container have be terminated
> ----------------------------------------------------------------------------------------
>                 Key: YARN-4382
>                 URL: https://issues.apache.org/jira/browse/YARN-4382
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.5.2
>            Reporter: lachisis
>            Assignee: Jun Gong
> If we use LinuxContainerExecutor to executor the containers, this question may happens.
> In the common case, when a container run, a corresponding hierarchy will be created in
cgroup dir. And when the container terminate, the hierarchy  will be delete in some seconds(this
time can be configured by yarn.nodemanager.linux-container-executor.cgroups.delete-delay-ms).
> In the code, I find that, CgroupsLCEResource send a signal to kill container process
asynchronously, and in the same time, it will try to delete the container hierarchy  in configured
"delete-delay-ms" times. 
> But if the container process be killed for seconds which large than "delete-delay-ms"
time, the  container hierarchy  will remain for ever.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message