airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sheikh Aslam Ahmed (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-962) Dag runs are deadlocked for DAG scheduled for @once
Date Fri, 10 Mar 2017 07:38:04 GMT
Sheikh Aslam Ahmed created AIRFLOW-962:
------------------------------------------

             Summary: Dag runs are deadlocked for DAG scheduled for @once
                 Key: AIRFLOW-962
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-962
             Project: Apache Airflow
          Issue Type: Bug
          Components: DagRun
         Environment: airflow v1.7.1.3 installed AWS cluster node
with celery executor ,rabbitMQ service and mysql for meta store
            Reporter: Sheikh Aslam Ahmed


We read mysql table row from python script and create dags out of it, any change in the row
leads to change in the dag.
we schedule dag based on inputs(like @once,hourly, daily etc).

>From last few days hourly and other scheduled profiles run properly but profile with schedule
@once got failed (on web UI no task got picked up from the DAG). the error in the logs shows
message as ' {jobs.py:538} ERROR - Dag runs are deadlocked for DAG: dagname'

after that if we trigger a manual run for same DAG from web UI it run and complete successfully.
 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message