airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Riccomini (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-15) Remove GCloud from Airflow
Date Thu, 28 Apr 2016 14:43:12 GMT
Chris Riccomini created AIRFLOW-15:
--------------------------------------

             Summary: Remove GCloud from Airflow
                 Key: AIRFLOW-15
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-15
             Project: Apache Airflow
          Issue Type: Task
            Reporter: Chris Riccomini
            Assignee: Chris Riccomini


After speaking with Google, there was some concern about using the [gcloud-python|https://github.com/GoogleCloudPlatform/gcloud-python]
library for Airflow. There are several concerns:

# It's not clear (even to people at Google) what this library is, who owns it, etc.
# It does not support all services (the way [google-api-python-client|https://github.com/google/google-api-python-client]
does).
# There are compatibility issues between google-api-python-client and gcloudpython.

We currently support both, after libraries depending on which package you you install: {{airfow[gcp_api]}}
or {{airflow[gcloud]}}. This ticket is to remove the {{airflow[gcloud]}} packaged, and all
associated code.

The main associated code, afaik, is the use of the {{gcloud}} library in the Google cloud
storage hooks/operators--specifically for Google cloud storage Airfow logging.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message