airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ali Uz <ali...@gmail.com>
Subject HttpOperator handling large GET response
Date Wed, 08 Mar 2017 16:18:42 GMT
Hello,

I want to use the HttpOperator to issue a GET request and pass a fairly
large response to another task. Is there any best way to handle this? I
think pushing a large object to xcom is not recommended. Should I just
write a custom operator that will fetch from the api and handle it as
necessary?

Would love to hear some thoughts.

Thanks!

 -Ali

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message