airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bolke de Bruin (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AIRFLOW-2068) Mesos Executor should allow specifying optional Docker image before running command
Date Mon, 23 Apr 2018 20:24:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bolke de Bruin resolved AIRFLOW-2068.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.10.0

Issue resolved by pull request #3008
[https://github.com/apache/incubator-airflow/pull/3008]

> Mesos Executor should allow specifying optional Docker image before running command
> -----------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-2068
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2068
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: executor
>    Affects Versions: Airflow 1.8
>            Reporter: Agraj Mangal
>            Assignee: Agraj Mangal
>            Priority: Major
>             Fix For: 1.10.0
>
>
> In its current form, MesosExecutor schedules tasks on mesos slaves which just contain
airflow commands assuming that the mesos slaves already have airflow installed and configured
on them. This assumption goes against the Mesos philosophy of having a heterogeneous cluster.
> Since mesos provides an option to pull a docker image before actually running the actual
task/command so this improvement changes the mesos_executor.py to specify an optional docker
image containing airflow which can be pulled on slaves before running the actual airflow
command. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message