airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1181) Enable delete and list function for Google Cloud Storage Hook
Date Tue, 09 May 2017 17:53:04 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003164#comment-16003164
] 

ASF subversion and git services commented on AIRFLOW-1181:
----------------------------------------------------------

Commit 24f73c03259bd5a7a699ed5b6c4cd3d559bf9bf8 in incubator-airflow's branch refs/heads/master
from [~cheny258]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=24f73c0 ]

[AIRFLOW-1181] Add delete and list functionality to gcs_hook

Closes #2281 from mattuuh7/gcs-delete-list


> Enable delete and list function for Google Cloud Storage Hook
> -------------------------------------------------------------
>
>                 Key: AIRFLOW-1181
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1181
>             Project: Apache Airflow
>          Issue Type: New Feature
>            Reporter: Matthew Chen
>            Assignee: Matthew Chen
>            Priority: Minor
>             Fix For: 1.9.0
>
>
> current {{GoogleCloudStorageHook}} does not support delete of a file, nor does it support
listing of files based on prefix. We would like to have these features available for our use-case.

> The delete function should be able to return true if successfully deleted the object,
based on generation etc.
> The list function should be able to list all objects with the given prefix, able to page
through large result pages and return a list of all file names satisfying the given prefix
criteria



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message