airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Arnold (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2367) High POSTGRES DB CPU utilization
Date Mon, 23 Apr 2018 18:39:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

John Arnold updated AIRFLOW-2367:
---------------------------------
    Attachment: cpu.png

> High POSTGRES DB CPU utilization
> --------------------------------
>
>                 Key: AIRFLOW-2367
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2367
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: Airflow 2.0, 1.9.0
>            Reporter: John Arnold
>            Priority: Major
>         Attachments: cpu.png
>
>
> We are seeing steady state 70-90% CPU utilization.  It feels like a missing index kind
of problem, as our TPS rate is really low, I'm not seeing any long running queries, connection
counts are reasonable (low hundreds) and locks also look reasonable (not many exclusive /
write locks)
> We shut down the webserver and it doesn't go away, so it doesn't seem to be in that part
of the code. My guess is either the scheduler has an inefficient query, or the (Celery) executor
code path does.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message