airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Russell Pierce (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-761) Subdag Fails to Detect Completion of tasks
Date Sun, 15 Jan 2017 20:11:26 GMT
Russell Pierce created AIRFLOW-761:
--------------------------------------

             Summary: Subdag Fails to Detect Completion of tasks
                 Key: AIRFLOW-761
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-761
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
    Affects Versions: Airflow 1.7.1.3
         Environment: Ubuntu 14.04.4 LTS
MySQL 5.6.27 (AWS RDS)
CeleryExecutor
            Reporter: Russell Pierce
            Priority: Minor


Using the CeleryExecutor - I have a pretty basic SubDagOperator the tasks in the DAG are generated
by a factory and use a queue pool (if that matters, IDK).  What happens is that the SubDagOperator
never gets marked as success despite all tasks associated with the job being marked as success.
 I've validated that all have been marked as success via the webserver as well as a direct
query of the task_instance table.  Some part of the scheduler doesn't realize that ~ two of
the tasks on any given day have reached completion.  

I'm not sure what else is needed here for a successful bug report.  Please LMK.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message