beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Volquartz Lebech (JIRA)" <>
Subject [jira] [Commented] (BEAM-1648) Replace gsutil calls with Cloud Storage API
Date Wed, 29 Mar 2017 10:23:41 GMT


David Volquartz Lebech commented on BEAM-1648:

This issue is resolved by The contribution guideline
does not specify whether I should close this myself or if a maintainer will close it. Please
advise :-)

> Replace gsutil calls with Cloud Storage API
> -------------------------------------------
>                 Key: BEAM-1648
>                 URL:
>             Project: Beam
>          Issue Type: Wish
>          Components: sdk-py
>    Affects Versions: 0.5.0
>            Reporter: David Volquartz Lebech
>            Assignee: Ahmet Altay
> When using the {{DataflowRunner}} and {{--setup-file}} parameter, {{gsutil}} is used
for _some_ of the Cloud Storage uploads [here|].
This makes it difficult to run a pipeline in an environment where the Cloud Platform tools
are not installed -- e.g. a Docker Python container or a Heroku instance.
> The Storage API is used in other places such as [here|]
when staging the session and main SDK package, so I'm unsure if this is by design or an inconsistency
in the usage.
> Thank you for considering this.

This message was sent by Atlassian JIRA

View raw message