airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1357) Scheduler does not support zip files
Date Tue, 11 Jul 2017 19:05:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082784#comment-16082784
] 

ASF subversion and git services commented on AIRFLOW-1357:
----------------------------------------------------------

Commit 3b863f182d42dc1ba76c2623b9983698a682d5f7 in incubator-airflow's branch refs/heads/master
from [~ultrabug]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=3b863f1 ]

[AIRFLOW-1357] Fix scheduler zip file support

Zipped DAGs are supported on the models but not
taken into account
by the scheduler since 1.8. This fixes the issue.

Closes #2406 from ultrabug/jira_1357


> Scheduler does not support zip files
> ------------------------------------
>
>                 Key: AIRFLOW-1357
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1357
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.8.1
>            Reporter: Ultrabug
>            Priority: Critical
>             Fix For: 1.8.3
>
>         Attachments: fix_scheduler_zip_file_support.patch
>
>
> Users from 1.7 series of airflow using zipped DAGs are unable to migrate to 1.8+ series
because the scheduler does not detect/run them.
> The zipfile support is still present in the models.py file so the zipped DAGs do show
up on `airflow list_dags` but they are never executed by the scheduler since it only cares
for .py files.
> I'm attaching the fix for this, will also open a GH PR.
> Tested ok & in production here.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message