airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject incubator-airflow git commit: Add pool upgrade issue description
Date Thu, 09 Feb 2017 15:11:44 GMT
Repository: incubator-airflow
Updated Branches:
  refs/heads/master 61fb6a5e5 -> e63cb1fce

Add pool upgrade issue description


Branch: refs/heads/master
Commit: e63cb1fced9517397b7db9e2849bf01fcca63902
Parents: 61fb6a5
Author: Bolke de Bruin <>
Authored: Thu Feb 9 16:10:17 2017 +0100
Committer: Bolke de Bruin <>
Committed: Thu Feb 9 16:10:17 2017 +0100

---------------------------------------------------------------------- | 6 ++++++
 1 file changed, 6 insertions(+)
diff --git a/ b/
index 337b711..b56aca8 100644
--- a/
+++ b/
@@ -14,6 +14,12 @@ Systemd unit files have been updated. If you use systemd please make sure
to upd
 > Please note that the webserver does not detach properly, this will be fixed in a future
+### Tasks not starting although dependencies are met due to stricter pool checking
+Airflow 1.7.1 has issues with being able to over subscribe to a pool, ie. more slots could
be used than were
+available. This is fixed in Airflow 1.8.0, but due to past issue jobs may fail to start although
+dependencies are met after an upgrade. To workaround either temporarily increase the amount
of slots above
+the the amount of queued tasks or use a new pool.
 ### Less forgiving scheduler on dynamic start_date
 Using a dynamic start_date (e.g. `start_date =`) is not considered a best
practice. The 1.8.0 scheduler
 is less forgiving in this area. If you encounter DAGs not being scheduled you can try using
a fixed start_date and

View raw message