airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2932) GoogleCloudStorageHook - allow compression of file
Date Thu, 06 Sep 2018 10:52:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605628#comment-16605628
] 

jack commented on AIRFLOW-2932:
-------------------------------

[~xnuinside]  [~kaxilnaik] This is exactly my intention :) I hope this tweak will made
it to 1.10.1

> GoogleCloudStorageHook - allow compression of file
> --------------------------------------------------
>
>                 Key: AIRFLOW-2932
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2932
>             Project: Apache Airflow
>          Issue Type: Improvement
>    Affects Versions: 1.10.0
>            Reporter: jack
>            Priority: Major
>
> The  *upload*{color:#555555}({color}_bucket_{color:#555555}, {color}_object_{color:#555555}, {color}_filename_{color:#555555}, {color}_mime_type='application/octet-stream'_{color:#555555}){color}
function allows to upload file from local disk.
> The google cloud support GZIP and BigQuery can read GZIP files. So, most people upload
compressed files in order to save space.
> It would be nice if the upload function would be able to make the compression on it's
own (if asked by the user). This will save the trouble of having to compress the file by ourselves.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message