airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kamil Bregula (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (AIRFLOW-4157) FileToGoogleCloudStorageOperator should expose "multipart" uploading supported in GoogleCloudStorageHook.upload()
Date Tue, 26 Nov 2019 21:11:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kamil Bregula resolved AIRFLOW-4157.
------------------------------------
    Resolution: Cannot Reproduce

We have now Python API library. This ticket is not valid now.

> FileToGoogleCloudStorageOperator should expose "multipart" uploading supported in GoogleCloudStorageHook.upload()
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-4157
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4157
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>    Affects Versions: 1.10.2
>            Reporter: Evgeny Podlepaev
>            Priority: Major
>
> FileToGoogleCloudStorageOperator should allow "multipart" flag to be specified and passed
to GoogleCloudStorageHook.upload(). Uploading large files (gigabytes) in a single shot results
in an out of memory error.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message