airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amin Ghadersohi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-765) Auto detect dag dep files in dags folder and reload dag
Date Wed, 18 Jan 2017 08:40:26 GMT
Amin Ghadersohi created AIRFLOW-765:
---------------------------------------

             Summary: Auto detect dag dep files in dags folder and reload dag
                 Key: AIRFLOW-765
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-765
             Project: Apache Airflow
          Issue Type: New Feature
          Components: models
            Reporter: Amin Ghadersohi
            Assignee: Amin Ghadersohi
            Priority: Minor


This change will crawl each dag file for dependent python files that are in the dags folder
and add them to a dep_list and also store their last modified time. So now process_file can
change the last modified date of the all dependent files before deciding to reload a dag.
As a bonus this will also work with Variables, and allow the user to specify a glob of files
they would like to watch in another folder (such as yaml files) and when they change, trigger
a reload of the dag.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message