airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kaxil Naik (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-1883) Get File Size for objects in Google Cloud Storage
Date Mon, 04 Dec 2017 00:33:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kaxil Naik updated AIRFLOW-1883:
--------------------------------
    Description: 
I would want to get file size for objects in Google Cloud Storage. The use case is when the
files are uploaded to GCS bucket I would want to validate whether the file is uploaded correctly
by matching the file size.

Proposed Approach:
- Added a get_file_size() hook in gcs hook.
- Create an operator that allows getting the file size for a file.

  was:
I would want to get file size for objects in Google Cloud Storage. The use case is when the
files are uploaded to GCS bucket I would want to validate whether the file is uploaded correctly
by matching the file size.

Proposed Approach:
- Added a get_file_size() hook in gcs hook.
- Create an operator that allows to get the file size for a file.


> Get File Size for objects in Google Cloud Storage
> -------------------------------------------------
>
>                 Key: AIRFLOW-1883
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1883
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: contrib, gcp
>            Reporter: Kaxil Naik
>            Assignee: Kaxil Naik
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I would want to get file size for objects in Google Cloud Storage. The use case is when
the files are uploaded to GCS bucket I would want to validate whether the file is uploaded
correctly by matching the file size.
> Proposed Approach:
> - Added a get_file_size() hook in gcs hook.
> - Create an operator that allows getting the file size for a file.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message