airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xi Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1110) Error dag_id could not be found when dag_id exists
Date Tue, 05 Dec 2017 13:03:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278505#comment-16278505
] 

Xi Wang commented on AIRFLOW-1110:
----------------------------------

I ran into similar issues, check if you have errors from your dag py file, e.g. import error.
This may interrupt the scanning process of Airflow in the dag folder which result in some
dags are ignored. you can verify it manually by runing airflow list_dags to see if anything
missing from the list.

> Error dag_id could not be found when dag_id exists
> --------------------------------------------------
>
>                 Key: AIRFLOW-1110
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1110
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: DAG
>    Affects Versions: Airflow 1.8
>         Environment: Airflow 1.8, celery redis
>            Reporter: laomaotou
>
> In my tag, there are four tasks with this structure below:
> [t1, t2] -> [t3, t4]
> When this tag runs, t1 and t2 run successfully, but t3 and t4 are queued, but with "AirflowException:
dag_id could not be found.Either the dag did not exist or it failed to parse." And then, I
retry to run task t3 and t4, there is no error. I don't know the reason. And this error doesn't
arrive every time, sometime all tasks run successfully.
> Could you help me ?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message