airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (Jira)" <>
Subject [jira] [Commented] (AIRFLOW-6239) Last_dagruns endpoint incredibly slow
Date Fri, 13 Dec 2019 10:24:00 GMT


ASF subversion and git services commented on AIRFLOW-6239:

Commit bdcd7cd9d4e7896112462c3e1be906c50fe21940 in airflow's branch refs/heads/master from
Robin Edwards
[;h=bdcd7cd ]

[AIRFLOW-6239] Filter dags return by last_dagruns (#6804)

Add dag_ids get parameter to last_dagruns endpoint so can filter by the
set of dag_ids present on the dags view. This is intended to speed up
the response time on systems running a large number of dags.

> Last_dagruns endpoint incredibly slow
> -------------------------------------
>                 Key: AIRFLOW-6239
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: api, ui
>    Affects Versions: 2.0.0, 1.10.6
>            Reporter: Robin Edwards
>            Priority: Minor
>             Fix For: 1.10.7
> The last_dagruns endpoint returns all dags by default. This can be incredibly slow when
running are large amount of dags (1500+ in our case)
> The accompanying pull request adds a dag_ids get parameter to the dag_stats end point
which is populated by the dags present on the page.
> Please see previous issue for task_stats AIRFLOW-6095 which has already been merged with
a similar solution

This message was sent by Atlassian Jira

View raw message