airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szymon Bilinski (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-1686) S3Hook expose boto list_objects and deletion methods
Date Thu, 13 Sep 2018 09:51:00 GMT


Szymon Bilinski commented on AIRFLOW-1686:

Any updates on this? I found a year-old PR [here|[],] but
it seems to be Closed.

I think a generic {{list_objects}} method would be a nice addition, as it would allow to
sort/filter files by any criteria needed ( {{last_modified}} date in particular ). 

> S3Hook expose boto list_objects and deletion methods
> ----------------------------------------------------
>                 Key: AIRFLOW-1686
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: boto3, hooks
>            Reporter: Andy Hadjigeorgiou
>            Assignee: Andy Hadjigeorgiou
>            Priority: Minor
> To make S3Hook more useful, I propose exposing both list_objects and delete functions
from boto into the wrapper. Both of these methods span common tasks related to s3, and list_objects
provides the added value over list_keys with additional context (last modified timestamps).
> I'm working on adding both, will link PR here when ready. 

This message was sent by Atlassian JIRA

View raw message