airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fokko Driesprong (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AIRFLOW-2039) BigQueryOperator supports priority property
Date Fri, 02 Feb 2018 08:35:02 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Fokko Driesprong resolved AIRFLOW-2039.
---------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request #2980
[https://github.com/apache/incubator-airflow/pull/2980]

> BigQueryOperator supports priority property
> -------------------------------------------
>
>                 Key: AIRFLOW-2039
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2039
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>    Affects Versions: Airflow 2.0
>            Reporter: Yu Ishikawa
>            Assignee: Yu Ishikawa
>            Priority: Minor
>             Fix For: 2.0.0
>
>
> h3. Goals
>  - Add priority property to BigQueryOperator
> h3. Overview
> BigQuery has some quota. for instance Maximum concurrent slots per project for on-demand
pricing. In my opinion, some company would like to reduce the slots usage as much as possible. It
would be great to use batch mode of BigQuery.
>  
> - [https://cloud.google.com/bigquery/quotas]
> - [https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs#configuration.query.priority]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message