airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ali Uz <>
Subject HttpOperator handling large GET response
Date Wed, 08 Mar 2017 16:18:42 GMT

I want to use the HttpOperator to issue a GET request and pass a fairly
large response to another task. Is there any best way to handle this? I
think pushing a large object to xcom is not recommended. Should I just
write a custom operator that will fetch from the api and handle it as

Would love to hear some thoughts.



  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message