airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (AIRFLOW-1381) DockerOperator does not allow specification of temporary directory on host
Date Sun, 02 Sep 2018 18:07:02 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned AIRFLOW-1381:
-------------------------------------

    Assignee:     (was: Holden Karau's magical unicorn)

> DockerOperator does not allow specification of temporary directory on host
> --------------------------------------------------------------------------
>
>                 Key: AIRFLOW-1381
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1381
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: docker, operators
>    Affects Versions: 1.9.0
>         Environment: Causes failure under default conditions in OS X
>            Reporter: Benjamin Sims
>            Priority: Minor
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The Docker uses the standard TemporaryDirectory mechanism to add a volume to the container
which is mapped to a temporary directory on the host. 
> By default, TemporaryDirectory places this in a location such as /var/folders/xxx/xxxxx/T/airflowtmpyi9pnn6w.

> However, Docker on OS X only allows certain folders to be shared into a container. /var/folders
is not shared on OS X (and cannot be shared) and the operator will therefore fail with a 'Mounts
denied' message.
> This can be solved by setting the environment variable TMPDIR to a path which Docker
is able to share. However a solution to set this in the Operator itself would also be useful.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message