airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ryan Yuan (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (AIRFLOW-3318) Add a function to BigQueryHook to check the existence of a dataset.
Date Thu, 22 Nov 2018 01:25:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ryan Yuan closed AIRFLOW-3318.
------------------------------
    Resolution: Won't Do

> Add a function to BigQueryHook to check the existence of a dataset.
> -------------------------------------------------------------------
>
>                 Key: AIRFLOW-3318
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3318
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: contrib, gcp, hooks
>    Affects Versions: 1.10.0
>            Reporter: Ryan Yuan
>            Assignee: Ryan Yuan
>            Priority: Major
>
> To check the existence of a dataset in BigQuery, existing BigQueryHook only supports
either 1) using get_datasets_list() to get all the datasets and then searching the target
dataset from the list; or 2) using get_dataset().
> However, with get_dataset(), it raises AirflowException whenever an HttpError received.
So it has no capabilities to determine if the dataset exists or not.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message