airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (Jira)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-6239) Last_dagruns endpoint incredibly slow
Date Fri, 13 Dec 2019 10:24:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995529#comment-16995529
] 

ASF subversion and git services commented on AIRFLOW-6239:
----------------------------------------------------------

Commit bdcd7cd9d4e7896112462c3e1be906c50fe21940 in airflow's branch refs/heads/master from
Robin Edwards
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=bdcd7cd ]

[AIRFLOW-6239] Filter dags return by last_dagruns (#6804)

Add dag_ids get parameter to last_dagruns endpoint so can filter by the
set of dag_ids present on the dags view. This is intended to speed up
the response time on systems running a large number of dags.

> Last_dagruns endpoint incredibly slow
> -------------------------------------
>
>                 Key: AIRFLOW-6239
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6239
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: api, ui
>    Affects Versions: 2.0.0, 1.10.6
>            Reporter: Robin Edwards
>            Priority: Minor
>             Fix For: 1.10.7
>
>
> The last_dagruns endpoint returns all dags by default. This can be incredibly slow when
running are large amount of dags (1500+ in our case)
> The accompanying pull request adds a dag_ids get parameter to the dag_stats end point
which is populated by the dags present on the page.
> Please see previous issue for task_stats AIRFLOW-6095 which has already been merged with
a similar solution



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message