airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Feng Lu <fen...@google.com.INVALID>
Subject Re: Tasks in remain in queued status
Date Fri, 01 Jun 2018 23:20:44 GMT
What message broker and result backend are you using?
Please make sure they are persistent and data can survive between restarts.

On Fri, Jun 1, 2018 at 11:13 AM Pedro Machado <pedro@205datalab.com> wrote:

> Hi,
>
> I am sure this must have come up before but I a quick search of the list
> archive didn't return any results.
>
> I am running airflow 1.9 on docker using the CeleryExecutor.
>
> I am seeing tasks that stay in queued status for a long time. This morning,
> I restarted the scheduler service and the tasks started right away. I
> already have a few more in this state.
>
> What do you recommend to troubleshoot this problem?
>
> Thanks,
>
> Pedro
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message