airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Anand (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-78) airflow clear leaves dag_runs
Date Sat, 06 Aug 2016 17:30:20 GMT


Siddharth Anand commented on AIRFLOW-78:

In the schedule, there is a point where dag runs are created - this is where the check is.
There is a point after that in the scheduler where dag runs are read and task instances are
inserted. The check also needs to be placed there. When the clear reset the dag run state,
they the scheduler, because it doesn't have this check, starts running all of them, and doesn't
observe this parameter. We will simply also add this check to that point in the scheduler.
 It's a very simple fix. 

> airflow clear leaves dag_runs
> -----------------------------
>                 Key: AIRFLOW-78
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Wish
>          Components: cli
>    Affects Versions: Airflow 1.6.2
>            Reporter: Adrian Bridgett
>            Assignee: Norman Mu
>            Priority: Minor
> (moved from
> "airflow clear -c -d -s 2016-01-03 dagid"  doesn't clear the dagrun, it sets it to running
instead (apparently since this is often used to re-run jobs).
> However this then breaks max_active_runs=1 (I have to stop the scheduler, then airflow
clear, psql to delete the dagrun, then start the scheduler).
> This problem was probably seen on an Airflow 1.6.x install.

This message was sent by Atlassian JIRA

View raw message