airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Chen <chingchien.c...@gmail.com>
Subject High load in CPU of MySQL when running airflow
Date Tue, 07 Mar 2017 17:42:21 GMT
Hi  team,

We are using airflow v1.7.1.3 and schedule about 50 dags (each dags is
about 10 to one hour intervals). It's with LocalExecutor.

Recently, we noticed the RDS (MySQL 5.6.x with AWS) runs with ~100% CPU.
I am wondering if airflow scheduler and webserver can cause high CPU load
of MySQL, given ~50 dags?
I feel MySQL should be light load..

Thanks.
-Jason

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message