airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Germain TANGUY <germain.tan...@dailymotion.com>
Subject Deploy procedure for new/modify dags
Date Tue, 18 Jul 2017 06:56:27 GMT
Hello everybody,

I would like to know what are your procedure to deploy new versions of your DAGs, especially
for dags that have external dependencies (bash script..etc)
I use CeleryExecutor with multiples workers and so there is an issue of consistency between
workers, schedulers and webserver.

Today I pause the dags, I wait until all running tasks complete, I restart all airflow services
and unpause the dags. Is there a better way?

Best regards,

Germain T.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message