airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "George Leslie-Waksman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-435) Multiprocessing Scheduler is very slow
Date Wed, 17 Aug 2016 01:04:21 GMT
George Leslie-Waksman created AIRFLOW-435:
---------------------------------------------

             Summary: Multiprocessing Scheduler is very slow
                 Key: AIRFLOW-435
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-435
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: George Leslie-Waksman


The PR https://github.com/apache/incubator-airflow/pull/1636 has dramatically slowed down
the scheduler. Running code prior to 1636 will result in rapid scheduling of many tasks. After
1636, tasks can wait in a null state for minutes without being scheduled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message