airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edgar Rodriguez (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-1464) Improve performance on getting dag run tis in backfill job
Date Wed, 26 Jul 2017 00:58:00 GMT
Edgar Rodriguez created AIRFLOW-1464:
----------------------------------------

             Summary: Improve performance on getting dag run tis in backfill job
                 Key: AIRFLOW-1464
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1464
             Project: Apache Airflow
          Issue Type: Improvement
          Components: backfill
            Reporter: Edgar Rodriguez


Improve the way task instances are retrieved, using batch query on TIs. 
The following code snippet needs to be improved:
{code}
for ti in dag_run.get_task_instances():
    # all tasks part of the backfill are scheduled to run
    if ti.state == State.NONE:
        ti.set_state(State.SCHEDULED, session=session)
{code}




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message