airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-966) Celery Broker Transport Options
Date Tue, 05 Dec 2017 09:14:00 GMT


ASF subversion and git services commented on AIRFLOW-966:

Commit aa737a582c687e7105ef934ffc4da3dc78438235 in incubator-airflow's branch refs/heads/master
from [~bolke]
[;h=aa737a5 ]

[AIRFLOW-966] Make celery broker_transport_options configurable

Required for changing visibility timeout and other
options required
for Redis/SQS.

Closes #2842 from bolkedebruin/AIRFLOW-966

> Celery Broker Transport Options
> -------------------------------
>                 Key: AIRFLOW-966
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: celery, executor
>            Reporter: Desiree Cox
>            Assignee: Desiree Cox
>             Fix For: 1.9.1
> To use the CeleryExecutor with a Redis Sentinel broker, Celery must be provided with
a dictionary of broker_transport_options with a key/value pair telling it the name of the
desired redis service. There should be a broker_transport_options in the Celery section of
airflow.cfg and CeleryExecutor should pass the options into the Celery worker configuration.

This message was sent by Atlassian JIRA

View raw message