airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "neil90 (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2932) GoogleCloudStorageHook - allow compression of file
Date Sun, 09 Sep 2018 01:20:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16608266#comment-16608266
] 

neil90 commented on AIRFLOW-2932:
---------------------------------

Id like to take this task if its still available

> GoogleCloudStorageHook - allow compression of file
> --------------------------------------------------
>
>                 Key: AIRFLOW-2932
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2932
>             Project: Apache Airflow
>          Issue Type: Improvement
>    Affects Versions: 1.10.0
>            Reporter: jack
>            Priority: Major
>
> The  *upload*{color:#555555}({color}_bucket_{color:#555555}, {color}_object_{color:#555555}, {color}_filename_{color:#555555}, {color}_mime_type='application/octet-stream'_{color:#555555}){color}
function allows to upload file from local disk.
> The google cloud support GZIP and BigQuery can read GZIP files. So, most people upload
compressed files in order to save space.
> It would be nice if the upload function would be able to make the compression on it's
own (if asked by the user). This will save the trouble of having to compress the file by ourselves.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message