beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2150) Support for recursive wildcards in GcsPath
Date Wed, 03 May 2017 20:48:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995642#comment-15995642
] 

Daniel Halperin commented on BEAM-2150:
---------------------------------------

[~meunierd] -- can you point me at the GCS documentation for the API you're calling that accepts
recursive globs? I can't find it.

I believe we call this API: https://cloud.google.com/storage/docs/json_api/v1/objects/list
and it does not seem to accept wildcards.

I'm surely missing something.

> Support for recursive wildcards in GcsPath
> ------------------------------------------
>
>                 Key: BEAM-2150
>                 URL: https://issues.apache.org/jira/browse/BEAM-2150
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-java-core, sdk-java-gcp
>            Reporter: Devon Meunier
>            Assignee: Devon Meunier
>            Priority: Minor
>
> When working with heavily nested folder structures in Google Cloud Storage, it's great
to make use of recursive wildcards, which the current API explicitly does not support.
> This code hasn't been touched in 2 years so it's likely that simply no one's gotten around
to it yet.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message