airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amin Ghadersohi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-765) Auto detect dag dependency files, variables, and resource file changes and reload dag
Date Sat, 28 Jan 2017 03:33:24 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amin Ghadersohi updated AIRFLOW-765:
------------------------------------
    External issue URL: https://github.com/apache/incubator-airflow/pull/2015  (was: https://github.com/apache/incubator-airflow/pull/2001)

> Auto detect dag dependency files, variables, and resource file changes and reload dag
> -------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-765
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-765
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: models
>            Reporter: Amin Ghadersohi
>            Assignee: Amin Ghadersohi
>            Priority: Minor
>
> This change will crawl each dag file for dependent python files that are in the dags
folder and add them to a dep_list and also store their last modified time. So now process_file
can change the last modified date of the all dependent files before deciding to reload a dag.
> As a bonus this will also work with Variables, and allow the user to specify a glob of
files they would like to watch in another folder (such as yaml files) and when they change,
trigger a reload of the dag.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message