airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Arnold (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-2367) High POSTGRES DB CPU utilization
Date Mon, 23 Apr 2018 18:37:00 GMT
John Arnold created AIRFLOW-2367:

             Summary: High POSTGRES DB CPU utilization
                 Key: AIRFLOW-2367
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
    Affects Versions: Airflow 2.0, 1.9.0
            Reporter: John Arnold

We are seeing steady state 70-90% CPU utilization.  It feels like a missing index kind of
problem, as our TPS rate is really low, I'm not seeing any long running queries, connection
counts are reasonable (low hundreds) and locks also look reasonable (not many exclusive /
write locks)

We shut down the webserver and it doesn't go away, so it doesn't seem to be in that part of
the code. My guess is either the scheduler has an inefficient query, or the (Celery) executor
code path does.

This message was sent by Atlassian JIRA

View raw message