airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-966) Celery Broker Transport Options
Date Tue, 05 Dec 2017 09:14:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278242#comment-16278242
] 

ASF subversion and git services commented on AIRFLOW-966:
---------------------------------------------------------

Commit aa737a582c687e7105ef934ffc4da3dc78438235 in incubator-airflow's branch refs/heads/master
from [~bolke]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=aa737a5 ]

[AIRFLOW-966] Make celery broker_transport_options configurable

Required for changing visibility timeout and other
options required
for Redis/SQS.

Closes #2842 from bolkedebruin/AIRFLOW-966


> Celery Broker Transport Options
> -------------------------------
>
>                 Key: AIRFLOW-966
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-966
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: celery, executor
>            Reporter: Desiree Cox
>            Assignee: Desiree Cox
>             Fix For: 1.9.1
>
>
> To use the CeleryExecutor with a Redis Sentinel broker, Celery must be provided with
a dictionary of broker_transport_options with a key/value pair telling it the name of the
desired redis service. There should be a broker_transport_options in the Celery section of
airflow.cfg and CeleryExecutor should pass the options into the Celery worker configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message