airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Richard Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1225) Deprecated pandas class GbqConnector
Date Sat, 20 May 2017 17:25:04 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16018558#comment-16018558
] 

Richard Lee commented on AIRFLOW-1225:
--------------------------------------

This is a duplicate of AIRFLOW-1179 and can be closed now.

> Deprecated pandas class GbqConnector
> ------------------------------------
>
>                 Key: AIRFLOW-1225
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1225
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: hooks
>    Affects Versions: Airflow 1.8
>            Reporter: Dimo Boyadzhiev
>
> The BigQueryHook class is using pandas.io.gbq GbqConnector class but it has been deprecated
from pandas v0.20.1. On installation airflow required pandas version between 0.17 and 1.0.

> Because of that there is an error on DAG loading:
> {code}
>   File "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 263, in process_file
>     m = imp.load_source(mod_name, filepath)
>   File "/Users/dboyadzhiev/airflow/dags/ETL/HRSkyen/transformer.py", line 8, in <module>
>     from airflow.contrib.operators.bigquery_operator import BigQueryOperator
>   File "/usr/local/lib/python2.7/site-packages/airflow/contrib/operators/bigquery_operator.py",
line 17, in <module>
>     from airflow.contrib.hooks.bigquery_hook import BigQueryHook
>   File "/usr/local/lib/python2.7/site-packages/airflow/contrib/hooks/bigquery_hook.py",
line 27, in <module>
>     from pandas.io.gbq import GbqConnector, \
> ImportError: cannot import name GbqConnector
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message