airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yannick Einsweiler (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2137) Google Cloud Storage to BigQuery Operator to allow wildcards
Date Wed, 14 Mar 2018 17:09:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398904#comment-16398904
] 

Yannick Einsweiler commented on AIRFLOW-2137:
---------------------------------------------

Silly me. It's just a question of passing a list with one item instead of a string. So only
a documentation update will do here.

> Google Cloud Storage to BigQuery Operator to allow wildcards
> ------------------------------------------------------------
>
>                 Key: AIRFLOW-2137
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2137
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib, gcp, operators
>    Affects Versions: 1.9.1
>            Reporter: Daniel
>            Assignee: Daniel
>            Priority: Minor
>   Original Estimate: 5h
>  Remaining Estimate: 5h
>
> Currently, the GoogleCloudStorageToBigQuery Operator requires exact matches for files
that are to be uploaded to BigQuery. 
> This Issue proposes that, if a wildcard is provided, this is used to load all files that
match that wildcard expansion. The hook and cursor that this Operator is based off already
supports wildcards in the argument source_uris, so the update is minor.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message