Mailing-List: contact commits-help@airflow.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airflow.incubator.apache.org
Date: Sun, 22 Oct 2017 21:04:00 +0000 (UTC)
From: "Bolke de Bruin (JIRA)" <jira@apache.org>
To: commits@airflow.incubator.apache.org
Message-ID: <JIRA.13104708.1506332962000.30049.1508706240174@Atlassian.JIRA>
In-Reply-To: <JIRA.13104708.1506332962000@Atlassian.JIRA>
References: <JIRA.13104708.1506332962000@Atlassian.JIRA> <JIRA.13104708.1506332962988@jira-lw-us.apache.org>
Subject: [jira] [Commented] (AIRFLOW-1641) Task gets stuck in queued state
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sun, 22 Oct 2017 21:04:06 -0000


    [ https://issues.apache.org/jira/browse/AIRFLOW-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16214452#comment-16214452 ] 

Bolke de Bruin commented on AIRFLOW-1641:
-----------------------------------------

Cause I need the feedback: I don't experience the issue myself, it is pretty core in the scheduler what needs to be updated (the current patch doesn't work correctly), next to that the automated testing helps to catch some errors (tests don't pass currently).

Also in addition to what is written here you can also limit parallelism to workaround the issue. Staying in QUEUED means the task instance can't even start. Most likely due to load or memory issues. This should be dealt with correctly (that is the real issue Im trying the solve in de patch), but it will fail your task anyways.


> Task gets stuck in queued state
> -------------------------------
>
>                 Key: AIRFLOW-1641
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1641
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.8.0
>         Environment: Linux
>            Reporter: Mas
>            Assignee: Bolke de Bruin
>              Labels: queued, scheduler, stuck, task
>             Fix For: 1.9.0
>
>
> Hello,
> I have one dag with ~20 tasks. 
> The dags runs daily and some tasks can sometime last for hours, depending on the processed data behind.
> There are some interactions with AWS and a remote DB.
> I only use LocalExecutor.
> What this issue is about, is the fact that sometime (randomly, and without any clear reason) one of the tasks (here also, it is random) gets stuck in "queued" state and never starts running. 
> The manual workaround is to restart the task manually by clearing it.
> Does anyone have ideas about the issue behind, and how to avoid it for the future? 
> Thanks in advance for your help.
> PS: other people are facing the same behaviour: [link|https://stackoverflow.com/questions/45853013/airflow-tasks-get-stuck-at-queued-status-and-never-gets-running]


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)