airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bence Nagy (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-29) Decrease the default `dagbag_import_timeout`
Date Mon, 02 May 2016 09:19:12 GMT
Bence Nagy created AIRFLOW-29:

             Summary: Decrease the default `dagbag_import_timeout`
                 Key: AIRFLOW-29
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Bence Nagy
            Priority: Minor

The default setting as of 1.7.0 is:

dagbag_import_timeout = 30

I don't think there's any reason for DAG imports to take over 1 second. I didn't always know
this though, and had a DAG earlier that made DB queries on each run making the scheduler a
lot slower than it should've been. I feel like having a really low default setting would be
a nice way to make sure users don't do silly things like I did, if coupled with helpful error

Original issue:

This message was sent by Atlassian JIRA

View raw message