airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Gong <go...@hotmail.com>
Subject external task dependency across 2 different servers
Date Thu, 17 Nov 2016 18:40:58 GMT
Hi,


Is it possible that 1 task can depend on another task running on another DAG on another sever?


For example, I have task1 in dag1, and  task2 in dag2.


If both dag1 and dag2 running on the same airflow instance on the same server, airflow provides
the ExternalTaskSensor operator.


But if dag2 runs on another airflow instance on another sever, can airflow allow dag1's task1
depend on dag2's task2?



Any suggestions are welcomed.


thanks



Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message