airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fokko Driesprong (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AIRFLOW-2033) Create Google Cloud Storage List Operator
Date Fri, 26 Jan 2018 10:29:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Fokko Driesprong resolved AIRFLOW-2033.
---------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request #2974
[https://github.com/apache/incubator-airflow/pull/2974]

> Create Google Cloud Storage List Operator
> -----------------------------------------
>
>                 Key: AIRFLOW-2033
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2033
>             Project: Apache Airflow
>          Issue Type: Task
>          Components: gcp
>    Affects Versions: Airflow 2.0, 1.10.0
>            Reporter: Kaxil Naik
>            Assignee: Kaxil Naik
>            Priority: Trivial
>             Fix For: 2.0.0
>
>
> There is an option in GCS hook to get the names of objects in a bucket filtered by prefix
and delimiter. An operator that returns would be helpful. This operator would return a python
list containing object names. A downstream task with python operator can be used to retrieve
these file names using xcom.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message