airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-680) Making `airflow run` not use a db connection pool
Date Wed, 07 Dec 2016 00:39:58 GMT
Dan Davydov created AIRFLOW-680:
-----------------------------------

             Summary: Making `airflow run` not use a db connection pool
                 Key: AIRFLOW-680
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-680
             Project: Apache Airflow
          Issue Type: Improvement
          Components: core
            Reporter: Dan Davydov
            Assignee: Dan Davydov


The goal here is to reduce the number of active database sessions on the metadata database.
Note that sqla create database connection pools and that when we have thousands of tasks emitting
heartbeats it can lead to way too many connections, ultimately maxing out on the MySQL side.
#1002 describes the issue.
(quoted from mistercrunch: https://github.com/apache/incubator-airflow/pull/1021)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message