mesos-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mao Geng (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (MESOS-7692) Default environment variables defined in docker image are not available in mesos containerizer
Date Wed, 21 Jun 2017 07:35:00 GMT

    [ https://issues.apache.org/jira/browse/MESOS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057090#comment-16057090
] 

Mao Geng edited comment on MESOS-7692 at 6/21/17 7:34 AM:
----------------------------------------------------------

Here is one of the ACCEPT messages sent from framework (capture via tcpdump and formatted):

{code}
{
    "accept": {
        "offer_ids": {
            "value": "55541916-22e8-41c5-a7fa-acf9a0f5836a-O100854"
        },
        "operations": [
            {
                "launch": {
                    "task_infos": [
                        {
                            "agent_id": {
                                "value": "f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S11"
                            },
                            "command": {
                                "environment": {
                                    "variables": [
                                        {
                                            "name": "PYTHONPATH",
                                            "value": "/usr/local/bin:/:/usr/lib/python2.7:/usr/lib/python2.7/plat-x86_64-linux-gnu:/usr/lib/python2.7/lib-tk:/usr/lib/python2.7/lib-old:/usr/lib/python2.7/lib-dynload:/usr/local/lib/python2.7/dist-packages:/usr/lib/python2.7/dist-packages"
                                        }
                                    ]
                                },
                                "shell": true,
                                "value": "/usr/bin/python -m tfmesos.server 1 <host>:<port>"
                            },
                            "container": {
                                "docker": {
                                    "image": "<image_name>",
                                    "parameters": [
                                        {
                                            "key": "memory-swap",
                                            "value": "-1"
                                        }
                                    ]
                                },
                                "type": "DOCKER",
                                "volumes": [
                                    {
                                        "container_path": "/etc/passwd",
                                        "host_path": "/etc/passwd",
                                        "mode": "RO"
                                    },
                                    {
                                        "container_path": "/etc/group",
                                        "host_path": "/etc/group",
                                        "mode": "RO"
                                    }
                                ]
                            },
                            "name": "/job:worker/task:0",
                            "resources": [
                                {
                                    "name": "cpus",
                                    "scalar": {
                                        "value": 5.0
                                    },
                                    "type": "SCALAR"
                                },
                                {
                                    "name": "mem",
                                    "scalar": {
                                        "value": 8192.0
                                    },
                                    "type": "SCALAR"
                                }
                            ],
                            "task_id": {
                                "value": "1"
                            }
                        }
                    ]
                },
                "type": "LAUNCH"
            }
        ]
    },
    "framework_id": {
        "value": "55541916-22e8-41c5-a7fa-acf9a0f5836a-0017"
    },
    "type": "ACCEPT"
}
{code}


was (Author: gengmao):
Here is one of the ACCEPT messages sent from framework (capture via tcpdump and formatted):

{code}
{
    "accept": {
        "offer_ids": {
            "value": "55541916-22e8-41c5-a7fa-acf9a0f5836a-O100854"
        },
        "operations": [
            {
                "launch": {
                    "task_infos": [
                        {
                            "agent_id": {
                                "value": "f2bcc63d-e887-4e25-b2c0-3772dfb40fb0-S11"
                            },
                            "command": {
                                "environment": {
                                    "variables": [
                                        {
                                            "name": "PYTHONPATH",
                                            "value": "/usr/local/bin:/:/usr/lib/python2.7:/usr/lib/python2.7/plat-x86_64-linux-gnu:/usr/lib/python2.7/lib-tk:/usr/lib/python2.7/lib-old:/usr/lib/python2.7/lib-dynload:/usr/local/lib/python2.7/dist-packages:/usr/lib/python2.7/dist-packages"
                                        }
                                    ]
                                },
                                "shell": true,
                                "value": "/usr/bin/python -m tfmesos.server 1 <host>:<port>"
                            },
                            "container": {
                                "docker": {
                                    "image": "<image_name>",
                                    "parameters": [
                                        {
                                            "key": "memory-swap",
                                            "value": "-1"
                                        }
                                    ]
                                },
                                "type": "DOCKER",
                                "volumes": [
                                    {
                                        "container_path": "/etc/passwd",
                                        "host_path": "/etc/passwd",
                                        "mode": "RO"
                                    },
                                    {
                                        "container_path": "/etc/group",
                                        "host_path": "/etc/group",
                                        "mode": "RO"
                                    }
                                ]
                            },
                            "name": "/job:worker/task:0",
                            "resources": [
                                {
                                    "name": "cpus",
                                    "scalar": {
                                        "value": 5.0
                                    },
                                    "type": "SCALAR"
                                },
                                {
                                    "name": "mem",
                                    "scalar": {
                                        "value": 8192.0
                                    },
                                    "type": "SCALAR"
                                }
                            ],
                            "task_id": {
                                "value": "1"
                            }
                        }
        ]
    },
    "framework_id": {
        "value": "55541916-22e8-41c5-a7fa-acf9a0f5836a-0017"
    },
    "type": "ACCEPT"
}
{code}

> Default environment variables defined in docker image are not available in mesos containerizer
> ----------------------------------------------------------------------------------------------
>
>                 Key: MESOS-7692
>                 URL: https://issues.apache.org/jira/browse/MESOS-7692
>             Project: Mesos
>          Issue Type: Bug
>          Components: containerization
>    Affects Versions: 1.3.0
>            Reporter: Mao Geng
>            Assignee: Till Toenshoff
>            Priority: Blocker
>             Fix For: 1.3.1
>
>
> Found an unexpected change in 1.3.0-2.0.3 - the environment variables defined by ENV
statements in dockerfile are not available in mesos containerizer any more. For example LD_LIBRARY_PATH
of tensorflow/tensorflow:latest-gpu image, JAVA_HOME of java:8 image, etc. 
> The env vars are available in mesos containerizer in 1.2.0. Looks like a regression to
me, isn't it? 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message