airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fokko Driesprong (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2997) Support for clustered tables in Bigquery hooks/operators
Date Tue, 04 Sep 2018 07:30:05 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Fokko Driesprong updated AIRFLOW-2997:
--------------------------------------
    Fix Version/s: 1.10.1

> Support for clustered tables in Bigquery hooks/operators
> --------------------------------------------------------
>
>                 Key: AIRFLOW-2997
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2997
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>            Reporter: Gordon Ball
>            Priority: Minor
>             Fix For: 1.10.1
>
>
> Bigquery support for clustered tables was added (at GCP "Beta" level) on 2018-07-30.
This feature allows load or table-creating query operations to request that data be stored
sorted by a subset of columns, allowing more efficient (and potentially cheaper) subsequent
queries.
>  Support for specifying fields to cluster on should be added to at least the bigquery
hook, load-from-GCS operator and query operator.
>  Documentation: https://cloud.google.com/bigquery/docs/clustered-tables



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message