airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Victor Villas Bôas Chaves (JIRA) <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-3365) Missing visibility_timeout will overwrite celery broker transport options
Date Mon, 19 Nov 2018 13:33:00 GMT
Victor Villas Bôas Chaves created AIRFLOW-3365:
--------------------------------------------------

             Summary: Missing visibility_timeout will overwrite celery broker transport options
                 Key: AIRFLOW-3365
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3365
             Project: Apache Airflow
          Issue Type: Bug
          Components: configuration
    Affects Versions: 1.10.0
            Reporter: Victor Villas Bôas Chaves


If you specify the region in your airflow.cfg like this:

{{[celery_broker_transport_options] }}

{{region = us-east-2 }}

it gets ignored.

This is ignored because Airflow checks to see if the {{visibility_timeout}} parameter is set
in the transport options and, if it's not set, replaces the transport options completely with
{{{'visibility_timeout': 21600}}} (at [https://github.com/apache/incubator-airflow/blob/master/airflow/config_templates/default_celery.py#L40]).

If you add {{visibility_timeout}}, the region is correctly set:

{{[celery_broker_transport_options] }}

{{region = us-east-2 }}

{{visibility_timeout = 21600 }}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message