airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ash Berlin-Taylor (Jira)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-5930) Reduce time spent building SQL strings
Date Thu, 14 Nov 2019 13:44:00 GMT
Ash Berlin-Taylor created AIRFLOW-5930:
------------------------------------------

             Summary: Reduce time spent building SQL strings
                 Key: AIRFLOW-5930
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5930
             Project: Apache Airflow
          Issue Type: Improvement
          Components: scheduler
    Affects Versions: 2.0.0
            Reporter: Ash Berlin-Taylor


My profling of the scheduler work turned up a lot of cases where the scheduler_job/dag parser
process was spending a lot of time building (not executing!) the SQL string.

This can be improved with https://docs.sqlalchemy.org/en/13/orm/extensions/baked.html



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message