hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhankun Tang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory
Date Wed, 31 Aug 2016 03:58:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451008#comment-15451008
] 

Zhankun Tang commented on YARN-5428:
------------------------------------

[~shanekumpf@gmail.com], thanks for the proposal. 

Just one question about 4.2(Distribute Application Owner Supplied Docker Client Configuration with
the Application), how could we ensure that the config.json localization procedure happens
before Docker image pull in the same localization phase (coordinate with YARN-3854)? I guess
 Marathon and K8s don't need to consider this because they assume docker pull will be implicitly
invoked.

If I remember correctly, We could prioritize the docker.tar.gz download theoretically because
all LocalResource is downloaded one by one per ContainerLocalizer. But any other idea on this?

> Allow for specifying the docker client configuration directory
> --------------------------------------------------------------
>
>                 Key: YARN-5428
>                 URL: https://issues.apache.org/jira/browse/YARN-5428
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: yarn
>            Reporter: Shane Kumpf
>            Assignee: Shane Kumpf
>         Attachments: YARN-5428.001.patch, YARN-5428.002.patch, YARN-5428.003.patch, YARN-5428.004.patch,
YARN-5428Allowforspecifyingthedockerclientconfigurationdirectory.pdf
>
>
> The docker client allows for specifying a configuration directory that contains the docker
client's configuration. It is common to store "docker login" credentials in this config, to
avoid the need to docker login on each cluster member. 
> By default the docker client config is $HOME/.docker/config.json on Linux. However, this
does not work with the current container executor user switching and it may also be desirable
to centralize this configuration beyond the single user's home directory.
> Note that the command line arg is for the configuration directory NOT the configuration
file.
> This change will be needed to allow YARN to automatically pull images at localization
time or within container executor.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message