airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1143) Tasks rejected by workers get stuck in QUEUED
Date Tue, 25 Apr 2017 03:26:04 GMT
Dan Davydov created AIRFLOW-1143:

             Summary: Tasks rejected by workers get stuck in QUEUED
                 Key: AIRFLOW-1143
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
            Reporter: Dan Davydov

If the scheduler schedules a task that is sent to a worker that then rejects the task (e.g.
because one of the dependencies of the tasks became bad, like the pool became full), the task
will be stuck in the QUEUED state.

Restarting the scheduler fixes this because it cleans up orphans, but we shouldn't have to
restart the scheduler to fix these problems (the missing job heartbeats should make the scheduler
requeue the task).

This message was sent by Atlassian JIRA

View raw message