airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Weise <...@apache.org>
Subject Filtering DAGs in process_file
Date Fri, 07 Apr 2017 00:41:12 GMT
Hi,

I want to include custom filtering logic into process_file when loading
DAGs from dag_folder.

For that I need the file path and the DAG object that contains owner and
name. Based on these 3 pieces of information, I want to decide whether to
accept the DAG or not.

It is possible to modify airflow/models.py to add this custom logic, but
I'm looking for a way to accomplish that via configuration vs. code change.
Are there any suggestions how to address this (maybe by adding a plug-in or
a configurable expression)?

Thanks,
Thomas

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message