hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nathan Roberts (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-2904) Use linux cgroups to enhance container tear down
Date Tue, 25 Nov 2014 21:21:12 GMT
Nathan Roberts created YARN-2904:

             Summary: Use linux cgroups to enhance container tear down
                 Key: YARN-2904
                 URL: https://issues.apache.org/jira/browse/YARN-2904
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: nodemanager
    Affects Versions: 2.6.0
            Reporter: Nathan Roberts

If we are launching yarn containers within cgroups, linux provides some guarantees that can
help completely tear down a container.  Specifically, linux guarantees that tasks can't escape
a cgroup. We can use this fact to tear down a yarn container without leaking tasks.

Today, a SIGTERM is sent to the session (normally lead by bash). When the session leader exits,
the LCE sees this and assumes all resources have been given back to the system. This is not
guaranteed. Example: YARN-2809 implements a workaround that is only necessary because tasks
are still lingering within the cgroup when the nodemanager attempts to delete it.  

This message was sent by Atlassian JIRA

View raw message