hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8643) Docker image life cycle management on HDFS
Date Wed, 23 Jan 2019 21:46:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750456#comment-16750456

Eric Yang commented on YARN-8643:

Subtask can not have more subtask.  Therefore, I opened YARN-9228 as the umbrella JIRA to
cover all the research and development subtasks for hosting docker images on HDFS.

> Docker image life cycle management on HDFS
> ------------------------------------------
>                 Key: YARN-8643
>                 URL: https://issues.apache.org/jira/browse/YARN-8643
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: yarn
>            Reporter: Eric Yang
>            Priority: Major
>              Labels: Docker
>         Attachments: Deploy_HDFS_Docker_registry_workflow.png, HDFS_Docker_registry_design.png
> This JIRA is forking an idea proposed in YARN-3854 to manage trusted docker images on
HDFS.  YARN-3854 is going to focus on rearranging the node manager and container-executor
logic to download docker image during file localization phase for better error handling and
reporting.  The new proposal is to create a docker container which host Docker registry and
NFS gateway, and configure docker images to store on HDFS.  The docker container can run in
YARN framework to serve as privileged or trusted registries.
> HDFS_Docker_registry_design.png describes the components required to create a docker
image that can store docker images on HDFS.
> Deploy_HDFS_Docker_registry_workflow.png describes the operation to perform to setup
a trusted docker registry that write to HDFS.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message