hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Prewo (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-8783) Property docker.trusted.registries does not work when using a list
Date Tue, 18 Sep 2018 10:36:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16618872#comment-16618872
] 

Simon Prewo edited comment on YARN-8783 at 9/18/18 10:35 AM:
-------------------------------------------------------------

[~shanekumpf@gmail.com], [~eyang] Thanks a lot for you great support.

[~shanekumpf@gmail.com]: I tried the library-approach and it works. However, I stayed with
tagging for now.

Let me summarize for others (findings this on Google) what helped:

1) Pull centos image and tag it:
{code:java}
docker pull centos && docker tag centos local/centos{code}
2) Add _local_ repository to docker.trusted.registries in container-executor.cfg
{code:java}
[docker]
  ...
  docker.trusted.registries=local 
{code}
3) Set YARN_CONTAINER_RUNTIME_DOCKER_IMAGE to the name of your tag (in our case local/centos).
I.e. execute distributed shell like this:
{code:java}
yarn jar hadoop-yarn-applications-distributedshell.jar -shell_env YARN_CONTAINER_RUNTIME_TYPE=docker
-shell_env YARN_CONTAINER_RUNTIME_DOCKER_IMAGE=local/centos -shell_command "sleep 90" -jar
hadoop-yarn-applications-distributedshell.jar -num_containers 1 {code}


was (Author: simonprewo):
[~shanekumpf@gmail.com], [~eyang] Thanks a lot for you great support.

[~shanekumpf@gmail.com]: I tried the library-approach and it works. However, I stayed with
tagging for now.

Let me summarize for others (findings this on Google) what helped:

1) Pull centos image and tag it:
{code:java}
docker pull centos && docker tag centos local/centos:latest{code}
2) Add _local_ repository to docker.trusted.registries in container-executor.cfg
{code:java}
[docker]
  ...
  docker.trusted.registries=local 
{code}
3) Set YARN_CONTAINER_RUNTIME_DOCKER_IMAGE to the name of your tag (in our case local/centos:latest).
I.e. execute distributed shell like this:
{code:java}
yarn jar hadoop-yarn-applications-distributedshell.jar -shell_env YARN_CONTAINER_RUNTIME_TYPE=docker
-shell_env YARN_CONTAINER_RUNTIME_DOCKER_IMAGE=local/centos:latest -shell_command "sleep 90"
-jar hadoop-yarn-applications-distributedshell.jar -num_containers 1 {code}

> Property docker.trusted.registries does not work when using a list
> ------------------------------------------------------------------
>
>                 Key: YARN-8783
>                 URL: https://issues.apache.org/jira/browse/YARN-8783
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>    Affects Versions: 3.1.1
>            Reporter: Simon Prewo
>            Priority: Major
>              Labels: Docker, container-executor, docker
>
> I am deploying the default yarn distributed shell example:
> {code:java}
> yarn jar hadoop-yarn-applications-distributedshell.jar -shell_env YARN_CONTAINER_RUNTIME_TYPE=docker
-shell_env YARN_CONTAINER_RUNTIME_DOCKER_IMAGE=centos -shell_command "sleep 90" -jar hadoop-yarn-applications-distributedshell.jar
-num_containers 1{code}
> Having a *single trusted registry configured like this works*:
> {code:java}
> docker.trusted.registries=centos{code}
> But having *a list of trusted registries configured fails* ("Shell error output: image:
centos is not trusted."):
> {code:java}
> docker.trusted.registries=centos,ubuntu{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message