airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Yang (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-2762) Parallelize DAG parsing in webserver
Date Tue, 17 Jul 2018 19:53:00 GMT
Kevin Yang created AIRFLOW-2762:

             Summary: Parallelize DAG parsing in webserver
                 Key: AIRFLOW-2762
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Kevin Yang

Currently the webserver parses DagBag in a single thread fashion and causes the start up time
to be slow when we have large # of DAG files. Webservers should not need the actual DAG object
and this should be parallelized.

This message was sent by Atlassian JIRA

View raw message