Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 11 Apr 2017 18:58:41 +0000 (UTC)
From: "Miklos Szegedi (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13062604.1491616381000.259101.1491937121633@Atlassian.JIRA>
In-Reply-To: <JIRA.13062604.1491616381000@Atlassian.JIRA>
References: <JIRA.13062604.1491616381000@Atlassian.JIRA> <JIRA.13062604.1491616381618@jira-lw-us.apache.org>
Subject: [jira] [Commented] (YARN-6456) Isolation of Docker containers In
 LinuxContainerExecutor
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 11 Apr 2017 18:58:45 -0000


    [ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964813#comment-15964813 ] 

Miklos Szegedi commented on YARN-6456:
--------------------------------------

Thank you for the reply [~jlowe]. What I am thinking about is mounting only {{nm-local-dir/usercache/user/filecache}} and not the whole user folder. This would give the user some protection against malicious/faulty applications. Ideally {{nm-local-dir/usercache/user/appcache/application_1491598755372_0011/filecache}} is mounted only together with the current container dir, so that the container directories are not added but as you also said this might not be possible due to shuffle, other applications, etc. Maybe the container directories could be outside the application directory. That might be an overkill.

> Isolation of Docker containers In LinuxContainerExecutor
> --------------------------------------------------------
>
>                 Key: YARN-6456
>                 URL: https://issues.apache.org/jira/browse/YARN-6456
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Miklos Szegedi
>
> One reason to use Docker containers is to be able to isolate different workloads, even, if they run as the same user.
> I have noticed some issues in the current design:
> 1. DockerLinuxContainerRuntime mounts containerLocalDirs {{nm-local-dir/usercache/user/appcache/application_1491598755372_0011/}} and userLocalDirs {{nm-local-dir/usercache/user/}}, so that a container can see and modify the files of another container. I think the application file cache directory should be enough for the container to run in most of the cases.
> 2. The whole cgroups directory is mounted. Would the container directory be enough?
> 3. There is no way to enforce exclusive use of Docker for all containers. There should be an option that it is not the user but the admin that requires to use Docker.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org