airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Srikanth <>
Subject ExternalTaskSensor usage
Date Fri, 30 Jun 2017 17:51:56 GMT

I have a use case where a couple of dags(dag A & B) run at set intervals.
Both dags have sensors that trigger a BashOperator. I have a third dag that
is a long running process that needs to be started once(I use '@once').
This dag depends both dags A and B to be run at least once. So I added
ExternalTaskSensors. Is there a better way to do this?

I noticed that the ExternalTaskSensor poke() never succeeded. Looking at
the code, there seems to be an explicit check for execution time match.
Comment for "execution_delta" seems to suggest that this check should be
for an execution time after certain reference. Should't the check be
for "TI.execution_date
> dttm,"?

If this is a bug, I'd be happy to fix and PR. If not, what is the intent
behind this??


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message