airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-2138) Google Cloud Storage to Google Cloud Storage Operator to allow wildcards
Date Thu, 22 Feb 2018 06:47:00 GMT
Daniel created AIRFLOW-2138:
-------------------------------

             Summary: Google Cloud Storage to Google Cloud Storage Operator to allow wildcards
                 Key: AIRFLOW-2138
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2138
             Project: Apache Airflow
          Issue Type: Improvement
          Components: contrib, gcp, operators
    Affects Versions: 1.9.1
            Reporter: Daniel
            Assignee: Daniel


Similar to AIRFLOW-2137 - Google Cloud Storage to BigQuery Operator to allow wildcards,
This current operator requires the exact name of the object is provided as an argument.

This issue differs slightly to the above issue as the hook that this operator is based off
of (GoogleCloudStorageHook) does not support wildcard expansion. Therefore, this can be achieved
by listing the objects that match the wildcards using either prefix=, suffix=, or a combination
of the two based on the position of the asterix in the string.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message