airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yu Ishikawa (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-2341) Trigger timing should follow cron style when we use cron style schedule_interval
Date Wed, 18 Apr 2018 23:06:00 GMT
Yu Ishikawa created AIRFLOW-2341:
------------------------------------

             Summary: Trigger timing should follow cron style when we use cron style schedule_interval
                 Key: AIRFLOW-2341
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2341
             Project: Apache Airflow
          Issue Type: Wish
          Components: scheduler
            Reporter: Yu Ishikawa


I understand "The Airflow scheduler triggers the task soon after the {{start_date + scheduler_interval}} is
passed." in [FAQ|https://airflow.apache.org/faq.html#why-isn-t-my-task-getting-scheduled].
However, in my opinion, the trigger timing is confusing.

For example, when I set start_date to 2018-04-01 and set schedule_interval to '0 0 5 * *'
in a DAG, the DAG will be triggered on 2018-05-05. In general, we expect the job should be
trigger on 2018-04-05.

If we adapt the cron style scheduling, it should follow the trigger timing of the cron style
as well. Otherwise, we should have another option for the way of cron style scheduling, instead
of schedule_interval. What do you think?
{noformat}
default_args = {
    'start_date': datetime(2018, 4, 1),
}
dag_id = get_file_name(__file__)
dag = DAG(
    dag_id,
    default_args=default_args,
    catchup=True,
    schedule_interval='0 0 5 * *'){noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message