airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Capwell <dcapw...@gmail.com>
Subject As history grows UI gets slower
Date Mon, 28 Aug 2017 22:01:12 GMT
We are on 1.8.0 and have a monitor DAG that monitors the health of Airflow
and Celery every minute.  This has been running for awhile now and at 26k
dag runs. We see that the UI for this DAG is multiple seconds slower (6-7
second) than any other DAG.

My question is, what do people do about managing history as it grows over
time? Do people delete history after N or so days?

Thanks for your time reading this email

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message