airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-863) Example DAG start dates should be recent to avoid unnecessary backfills
Date Sun, 12 Feb 2017 20:38:42 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862959#comment-15862959
] 

ASF subversion and git services commented on AIRFLOW-863:
---------------------------------------------------------

Commit bbfd43df4663547abda4ac6fdc3a6ed730a75b57 in incubator-airflow's branch refs/heads/master
from [~jlowin]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=bbfd43d ]

[AIRFLOW-863] Example DAGs should have recent start dates

Avoid unnecessary backfills by having start dates
of
just a few days ago. Adds a utility function
airflow.utils.dates.days_ago().

Closes #2068 from jlowin/example-start-date


> Example DAG start dates should be recent to avoid unnecessary backfills
> -----------------------------------------------------------------------
>
>                 Key: AIRFLOW-863
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-863
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: examples
>    Affects Versions: 1.8.0rc3
>            Reporter: Jeremiah Lowin
>            Assignee: Jeremiah Lowin
>            Priority: Minor
>             Fix For: 1.8.1
>
>
> Posted on dev mailing list:
> "
> 2) when you install airflow, there are two new example DAGs
> (last_task_only) which are going back very far in the past and scheduled to
> run every hour - a bunch of dags triggered on the first start of scheduler
> and hosed my CPU
> "



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message