airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremiah Lowin <jlo...@apache.org>
Subject Re: Airflow + Celery + SQS
Date Mon, 30 Jan 2017 14:59:45 GMT
Jason,

I don't believe Airflow cares about Celery's backend as long as the task
API remains the same. You should be OK (though I haven't tested to
confirm).

J

On Sat, Jan 28, 2017 at 5:09 PM Jason Chen <chingchien.chen@gmail.com>
wrote:

> Hi Airflow team,
>
> Celery 4 supports AWS SQS
>  http://docs.celeryproject.org/en/latest/getting-started/brokers/sqs.html
>
> We are using Airflow 1.7.1.3
> Is there any problem, if we change config to use SQS for CeleryExecutor ?
>
> Thanks.
>
> Jason
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message