airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lance Norskog <lance.nors...@gmail.com>
Subject "intra-day" backfill mistake
Date Sat, 28 May 2016 01:22:35 GMT
I just made the same mistake, twice.

I have a Dag with this schedule:

dag = DAG(
    dag_id='xyz', default_args=args,
    schedule_interval='0 2 * * *',
    start_date=datetime(2016, 5, 16,2),
    max_active_runs=1
    )


It runs daily, at 2AM UTC. I ran this command:
airflow backfill -s 2016-05-24 xyz

So, of course, it created a new run at midnight UTC instead of running the
DAG at 2am.

Should 'airflow backfill' and similar respect the periodicity of the DAG?
Could these command give an error and require a flag to force running
outside the DAG's periodicity?

-- 
Lance Norskog
lance.norskog@gmail.com
Redwood City, CA

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message