airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joe Schmid (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1142) SubDAG Tasks Not Executed Even Though All Dependencies Met
Date Thu, 27 Apr 2017 04:35:04 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985991#comment-15985991
] 

Joe Schmid commented on AIRFLOW-1142:
-------------------------------------

I'm still seeing the issue even when running with v1-8-test + the PR for AIRFLOW-1142: https://github.com/apache/incubator-airflow/pull/2260.
In fact, when running with --run-duration 30 I see the issue consistently.

I'm attaching two more logs: run3-task.log and run3-scheduler-stdout.log

> SubDAG Tasks Not Executed Even Though All Dependencies Met
> ----------------------------------------------------------
>
>                 Key: AIRFLOW-1142
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1142
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: subdag
>    Affects Versions: 1.8.1
>         Environment: 1.8.1rc1+incubating, Celery
>            Reporter: Joe Schmid
>            Priority: Blocker
>         Attachments: 2017-04-24T23-20-38-776547, run3-scheduler-stdout.log, run3-task.log,
SubDAGOperatorTaskLog-DEBUG.txt, Test_Nested_SubDAG_0.png, Test_Nested_SubDAG_1-Zoomed.png,
test_nested_subdag.py
>
>
> Testing on 1.8.1rc1, we noticed that tasks in subdags were not getting executed even
though all dependencies had been met.
> We were able to create a simple test DAG that re-creates the issue. Attached is a test
DAG, the log file of the subdag operator that shows it fails to run even though dependencies
are met, and screenshots of what the UI looks like.
> This is definitely a regression as we have many similarly constructed DAGs that have
been running successfully on a pre-v1.8 version (a fork of 1.7.1.3+master) for some time.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message