airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Scott Halgrim <scott.halg...@zapier.com>
Subject Re: Executing Dags atomically
Date Fri, 02 Jun 2017 13:21:12 GMT
Try an ExternalTaskSensor

Thanks,

Scott

On Jun 2, 2017, 3:28 AM -0700, Zsolt Tóth <toth.zsolt.bme@gmail.com>, wrote:
> Hi,
>
> is there a way to execute all tasks of a dag without interruption? Right
> now the scheduler jumps between dags, and eventually they will all finish.
> What I want is to force the scheduler to finish a dag completely, and jump
> to the next one afterwards.
> I think I could set all tasks of the dag to the same priority, giving each
> dag a different prio this way, but then I'll also have a precedence between
> DAGs, which I don't want.
>
> Thanks,
> Zsolt

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message