airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "yuanyifang (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1550) Scheduler get stuck using param -r or -n
Date Wed, 30 Aug 2017 07:19:00 GMT
yuanyifang created AIRFLOW-1550:

             Summary: Scheduler get stuck using param -r or -n
                 Key: AIRFLOW-1550
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: yuanyifang

we use airflow scheduler -r or -n param in our project to make sure no task in queue status
which will cause no more task got scheduled. But we encountered another problem. We found
no task in any dag in running state except a hdfssensor and the scheduler did not stop as
we expected.
we think this is because scheduler waiting for all the running task finish and than quit running.
But the hdfssensor will waiting for a file ready for a long time. so the scheduler will not
quit and not schedu other task.

This message was sent by Atlassian JIRA

View raw message