airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nadeem Ahmed Nazeer (JIRA)" <>
Subject [jira] [Updated] (AIRFLOW-396) DAG status still running when all its tasks are complete
Date Thu, 04 Aug 2016 19:24:20 GMT


Nadeem Ahmed Nazeer updated AIRFLOW-396:
    Attachment:     (was: Dag_code)

> DAG status still running when all its tasks are complete
> --------------------------------------------------------
>                 Key: AIRFLOW-396
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: DagRun, scheduler
>    Affects Versions: Airflow 1.7.0
>            Reporter: Nadeem Ahmed Nazeer
>            Assignee: Siddharth Anand
>            Priority: Minor
>         Attachments: DagRuns.png, Dag_code.txt, Dag_no_input_files_still_running_state.png
> Hello,
> I am facing a situation with Airflow where it doesn't flag the DAG's as success even
though all of the tasks in that DAG are complete.
> I have a BranchPythonOperator which forks into running all downstream tasks or just a
single task (dummy operator as an endpoint) depending if files exists to be processed or not
for that cycle.
> I see that in the DAG's that go to the dummy operator, the status of the DAG always shows
running where its complete. I can't get to figure out what is stopping the scheduler from
marking this DAG success. Since it is in running state, every time the scheduler checks the
status of this DAG which is unnecessary.
> Please advise.
> Thanks,
> Nadeem

This message was sent by Atlassian JIRA

View raw message