airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kaxil Naik (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-1892) Added capability in BigQuery hook to extract data for selected columns
Date Thu, 07 Dec 2017 20:17:00 GMT
Kaxil Naik created AIRFLOW-1892:
-----------------------------------

             Summary: Added capability in BigQuery hook to extract data for selected columns
                 Key: AIRFLOW-1892
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1892
             Project: Apache Airflow
          Issue Type: Improvement
          Components: contrib, gcp
    Affects Versions: 1.10.0
            Reporter: Kaxil Naik
            Assignee: Kaxil Naik
            Priority: Minor
             Fix For: 1.10.0


The `get_tabledata` method in `bigquery_hook` currently does not support extracting data for
a specific field, instead, it extracts the full table.

The proposal is to add the parameter to extract data for specific columns from a BigQuery
table. The idea after that is to create an operator to get data in a python list.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message