airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-1357) Scheduler does not support zip files
Date Tue, 11 Jul 2017 19:05:00 GMT


ASF subversion and git services commented on AIRFLOW-1357:

Commit 3b863f182d42dc1ba76c2623b9983698a682d5f7 in incubator-airflow's branch refs/heads/master
from [~ultrabug]
[;h=3b863f1 ]

[AIRFLOW-1357] Fix scheduler zip file support

Zipped DAGs are supported on the models but not
taken into account
by the scheduler since 1.8. This fixes the issue.

Closes #2406 from ultrabug/jira_1357

> Scheduler does not support zip files
> ------------------------------------
>                 Key: AIRFLOW-1357
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.8.1
>            Reporter: Ultrabug
>            Priority: Critical
>             Fix For: 1.8.3
>         Attachments: fix_scheduler_zip_file_support.patch
> Users from 1.7 series of airflow using zipped DAGs are unable to migrate to 1.8+ series
because the scheduler does not detect/run them.
> The zipfile support is still present in the file so the zipped DAGs do show
up on `airflow list_dags` but they are never executed by the scheduler since it only cares
for .py files.
> I'm attaching the fix for this, will also open a GH PR.
> Tested ok & in production here.

This message was sent by Atlassian JIRA

View raw message