airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maxime Beauchemin <maximebeauche...@gmail.com>
Subject Re: changing DAG schedule_interval where depends_on_past=True
Date Sat, 09 Sep 2017 02:41:28 GMT
The `depends_on_past` check is always disregarded for the `start_date`, so
bumping the `start_date` to your first run of this new schedule is one way
to do this.

Another way could have been to introduce a TimeSensor upstream of the first
tasks that waits for 6am.

Max

On Fri, Sep 8, 2017 at 4:05 PM, Scott Halgrim <
scott.halgrim@zapier.com.invalid> wrote:

> Hi all,
>
> I want to move a DAG currently scheduled @daily (i.e., midnight) to be
> scheduled at 6 AM instead. The DAG has a task in it that has
> depends_on_past=True. It seems this task won’t run anew now because it
> looks 24 hours back and sees a task there hasn’t been run.
>
> What’s the best practice for making this change? Should I change the DAG’s
> start_date? Will that mess anything up?
>
> Thanks,
>
> Scott
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message