airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kaxil Naik (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (AIRFLOW-2266) GCP integrations (gcp_api extras) cannot be installed from Python 3
Date Sat, 28 Apr 2018 00:18:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kaxil Naik reassigned AIRFLOW-2266:
-----------------------------------

    Assignee: Kaxil Naik

> GCP integrations (gcp_api extras) cannot be installed from Python 3
> -------------------------------------------------------------------
>
>                 Key: AIRFLOW-2266
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2266
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: contrib
>         Environment: OS: macOS
> $ sw_vers
> ProductName:	Mac OS X
> ProductVersion:	10.13.3
> BuildVersion:	17D102
> Python 3.6.4
>            Reporter: Tim Swast`
>            Assignee: Kaxil Naik
>            Priority: Major
>
> As seen in https://issues.apache.org/jira/browse/AIRFLOW-2187, the google-cloud-dataflow
package only works from Python 2. This is what happens when I try to install the gcp_api extras
from a Python 3 environment:
>  
> |pip install apache-airflow[gcp_api]|
> |...
>  Collecting cryptography>=2.1.4 (from PyOpenSSL->apache-airflow[gcp_api])
>   Downloading cryptography-2.2.1-cp34-abi3-macosx_10_6_intel.whl (1.5MB)
>     100% \|████████████████████████████████\|
1.5MB 943kB/s
>  Collecting apache-beam[gcp]==2.3.0 (from google-cloud-dataflow->apache-airflow[gcp_api])
>   Could not find a version that satisfies the requirement apache-beam[gcp]==2.3.0 (from
google-cloud-dataflow->apache-airflow[gcp_api]) (from versions: 0.6.0, 2.0.0, 2.1.0, 2.1.1,
2.2.0)
>  No matching distribution found for apache-beam[gcp]==2.3.0 (from google-cloud-dataflow->apache-airflow[gcp_api])|
>  
> The other GCP APIs should be accessible from Python 3. My suggestion is to split the
gcp_extras into separate extras (or at least a separate extra for dataflow), similar to how
there is a separate extra for s3. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message