hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Leitao Guo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3282) DockerContainerExecutor should support environment variables setting
Date Wed, 04 Mar 2015 03:21:04 GMT

    [ https://issues.apache.org/jira/browse/YARN-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346315#comment-14346315

Leitao Guo commented on YARN-3282:

Hi [~ashahab], thanks for your comments. 

I agree with you that a docker image should try to be self-sufficient, but in our scenarios,
the data are stored in a remote shared  storage system, we mount these storage as a local
dirs to nodemanager, and only a few applications running in docker containers need to access
these dirs. So these dirs are not suitable as "yarn.nodemanager.local-dirs", which are mounted
to docker container as default. IMHO. I think an extra method to set environment variables
for docker containers is necessary.

> DockerContainerExecutor should support environment variables setting
> --------------------------------------------------------------------
>                 Key: YARN-3282
>                 URL: https://issues.apache.org/jira/browse/YARN-3282
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: applications, nodemanager
>    Affects Versions: 2.6.0
>            Reporter: Leitao Guo
>         Attachments: YARN-3282.01.patch
> Currently, DockerContainerExecutor will mount "yarn.nodemanager.local-dirs" and "yarn.nodemanager.log-dirs"
to containers automatically. However applications maybe need set more environment variables
before launching containers. 
> In our applications, just as the following command, we need to attach several directories
and set some environment variables to docker containers. 
> {code}
> docker run -i -t -v /data/transcode:/data/tmp -v /etc/qcs:/etc/qcs -v /mnt:/mnt -e VTC_MQTYPE=rabbitmq
-e VTC_APP=ugc -e VTC_LOCATION=sh -e VTC_RUNTIME=vtc sequenceiq/hadoop-docker:2.6.0 /bin/bash
> {code}

This message was sent by Atlassian JIRA

View raw message