airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dimo Boyadzhiev (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-1225) Deprecated pandas class GbqConnector
Date Thu, 18 May 2017 08:56:04 GMT
Dimo Boyadzhiev created AIRFLOW-1225:
----------------------------------------

             Summary: Deprecated pandas class GbqConnector
                 Key: AIRFLOW-1225
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1225
             Project: Apache Airflow
          Issue Type: Bug
          Components: hooks
    Affects Versions: Airflow 1.8
            Reporter: Dimo Boyadzhiev


The BigQueryHook class is using pandas.io.gbq GbqConnector class but it has been deprecated
from pandas v0.20.1. On installation airflow required pandas version between 0.17 and 1.0.


Because of that there is an error on DAG loading:

{code}
  File "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 263, in process_file
    m = imp.load_source(mod_name, filepath)
  File "/Users/dboyadzhiev/airflow/dags/ETL/HRSkyen/transformer.py", line 8, in <module>
    from airflow.contrib.operators.bigquery_operator import BigQueryOperator
  File "/usr/local/lib/python2.7/site-packages/airflow/contrib/operators/bigquery_operator.py",
line 17, in <module>
    from airflow.contrib.hooks.bigquery_hook import BigQueryHook
  File "/usr/local/lib/python2.7/site-packages/airflow/contrib/hooks/bigquery_hook.py", line
27, in <module>
    from pandas.io.gbq import GbqConnector, \
ImportError: cannot import name GbqConnector
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message