airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1641) Task gets stuck in queued state
Date Fri, 27 Oct 2017 13:57:01 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222410#comment-16222410
] 

ASF subversion and git services commented on AIRFLOW-1641:
----------------------------------------------------------

Commit 73549763eac74142b7c4018422bb2f8c897b45a8 in incubator-airflow's branch refs/heads/v1-9-test
from [~bolke]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=7354976 ]

[AIRFLOW-1641] Handle executor events in the scheduler

While in Backfills we do handle the executor
state,
we do not in the Scheduler. In case there is an
unspecified
error (e.g. a timeout, airflow command failure)
tasks
can get stuck.

Closes #2715 from bolkedebruin/AIRFLOW-1641

(cherry picked from commit 2abead7049806482047e29d123a109b444c00355)
Signed-off-by: Bolke de Bruin <bolke@xs4all.nl>


> Task gets stuck in queued state
> -------------------------------
>
>                 Key: AIRFLOW-1641
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1641
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.8.0
>         Environment: Linux
>            Reporter: Mas
>            Assignee: Bolke de Bruin
>            Priority: Blocker
>              Labels: queued, scheduler, stuck, task
>             Fix For: 1.9.0
>
>
> Hello,
> I have one dag with ~20 tasks. 
> The dags runs daily and some tasks can sometime last for hours, depending on the processed
data behind.
> There are some interactions with AWS and a remote DB.
> I only use LocalExecutor.
> What this issue is about, is the fact that sometime (randomly, and without any clear
reason) one of the tasks (here also, it is random) gets stuck in "queued" state and never
starts running. 
> The manual workaround is to restart the task manually by clearing it.
> Does anyone have ideas about the issue behind, and how to avoid it for the future? 
> Thanks in advance for your help.
> PS: other people are facing the same behaviour: [link|https://stackoverflow.com/questions/45853013/airflow-tasks-get-stuck-at-queued-status-and-never-gets-running]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message