airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sulphide (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2386) airflow backfill ignores depends_on_past when backfilling before start_date
Date Fri, 27 Apr 2018 13:26:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

sulphide updated AIRFLOW-2386:
------------------------------
    Description: 
When I run an airflow backfill using the airflow cli (i.e. airflow backfill -s somedate -e
someotherdate dag_id), if the start date of the backfill is before the start_date of the dag,
then airflow ignores depends_on_past and runs tasks in parallel for different days that have
depends_on_past set to true. If the end date of the backfill is after the start_date of the
dag then the backfill will begin respecting depends_on_past once it reaches the start_date
of the dag. Seems like a bug.

airflow 1.9
python 2.7.9
amazonlinux

  was:When I run an airflow backfill using the airflow cli (i.e. airflow backfill -s somedate
-e someotherdate dag_id), if the start date of the backfill is before the start_date of the
dag, then airflow ignores depends_on_past and runs tasks in parallel for different days that
have depends_on_past set to true. If the end date of the backfill is after the start_date
of the dag then the backfill will begin respecting depends_on_past once it reaches the start_date
of the dag. Seems like a bug.


> airflow backfill ignores depends_on_past when backfilling before start_date
> ---------------------------------------------------------------------------
>
>                 Key: AIRFLOW-2386
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2386
>             Project: Apache Airflow
>          Issue Type: Bug
>    Affects Versions: 1.9.0
>            Reporter: sulphide
>            Priority: Major
>
> When I run an airflow backfill using the airflow cli (i.e. airflow backfill -s somedate
-e someotherdate dag_id), if the start date of the backfill is before the start_date of the
dag, then airflow ignores depends_on_past and runs tasks in parallel for different days that
have depends_on_past set to true. If the end date of the backfill is after the start_date
of the dag then the backfill will begin respecting depends_on_past once it reaches the start_date
of the dag. Seems like a bug.
> airflow 1.9
> python 2.7.9
> amazonlinux



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message