airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1038) Specify celery serializers explicitly and pin version
Date Thu, 08 Jun 2017 15:37:18 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16042869#comment-16042869
] 

ASF subversion and git services commented on AIRFLOW-1038:
----------------------------------------------------------

Commit c39d91537bb8c28cc81aad3e26eff72158e3b1f4 in incubator-airflow's branch refs/heads/v1-8-test
from [~saguziel]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=c39d915 ]

[AIRFLOW-1038] Specify celery serialization options explicitly

Specify the CELERY_TASK_SERIALIZER and CELERY_RESULT_SERIALIZER as
pickle explicitly, and CELERY_EVENT_SERIALIZER as json.


> Specify celery serializers explicitly and pin version
> -----------------------------------------------------
>
>                 Key: AIRFLOW-1038
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1038
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Alex Guziel
>            Assignee: Alex Guziel
>             Fix For: 1.8.2
>
>
> Celery 3->4 upgrade changes the default task and result serializer from pickle to
json. Pickle is faster and supports more types http://docs.celeryproject.org/en/latest/userguide/calling.html
> This also causes issues when different versions of celery are running on different hosts.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message