Mailing-List: contact commits-help@airflow.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airflow.incubator.apache.org
Date: Wed, 30 Aug 2017 07:19:00 +0000 (UTC)
From: "yuanyifang (JIRA)" <jira@apache.org>
To: commits@airflow.incubator.apache.org
Message-ID: <JIRA.13098491.1504077509000.156790.1504077540080@Atlassian.JIRA>
In-Reply-To: <JIRA.13098491.1504077509000@Atlassian.JIRA>
References: <JIRA.13098491.1504077509000@Atlassian.JIRA> <JIRA.13098491.1504077509621@jira-lw-us.apache.org>
Subject: [jira] [Created] (AIRFLOW-1550) Scheduler get stuck using param -r
 or -n
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 30 Aug 2017 07:19:04 -0000

yuanyifang created AIRFLOW-1550:
-----------------------------------

             Summary: Scheduler get stuck using param -r or -n
                 Key: AIRFLOW-1550
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1550
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: yuanyifang


we use airflow scheduler -r or -n param in our project to make sure no task in queue status which will cause no more task got scheduled. But we encountered another problem. We found no task in any dag in running state except a hdfssensor and the scheduler did not stop as we expected.
we think this is because scheduler waiting for all the running task finish and than quit running. But the hdfssensor will waiting for a file ready for a long time. so the scheduler will not quit and not schedu other task.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)