airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1152) Backfill dagruns should not hang DAGs
Date Wed, 26 Apr 2017 19:23:04 GMT
Dan Davydov created AIRFLOW-1152:

             Summary: Backfill dagruns should not hang DAGs
                 Key: AIRFLOW-1152
             Project: Apache Airflow
          Issue Type: Bug
          Components: backfill
            Reporter: Dan Davydov

Backfills should have some kind of heartbeat mechanism that causes the scheduler to time out
and fail their dagruns if e.g. the backfill is interrupted. Otherwise you run into the case
where you have something like max_active_dagruns = 1 and a cancelled backrun that leaves its
dagrun in a running state causes the whole dag to hang.

This message was sent by Atlassian JIRA

View raw message