airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "George Leslie-Waksman (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-435) Multiprocessing Scheduler is very slow
Date Wed, 17 Aug 2016 01:04:21 GMT
George Leslie-Waksman created AIRFLOW-435:

             Summary: Multiprocessing Scheduler is very slow
                 Key: AIRFLOW-435
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: George Leslie-Waksman

The PR has dramatically slowed down
the scheduler. Running code prior to 1636 will result in rapid scheduling of many tasks. After
1636, tasks can wait in a null state for minutes without being scheduled.

This message was sent by Atlassian JIRA

View raw message