airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Crawford (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-1114) S3Hook doesn't support Minio
Date Mon, 09 Oct 2017 13:18:00 GMT


Michael Crawford commented on AIRFLOW-1114:

have a look at AIRFLOW-115 . Looks like there is already a proposal to refactor the s3 hooks
which is widely supported.

> S3Hook doesn't support Minio
> ----------------------------
>                 Key: AIRFLOW-1114
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: aws, hooks
>    Affects Versions: Airflow 1.8
>         Environment: I am running it from the following Docker image:
>            Reporter: Alessandro Cosentino
> I want to mock an S3 bucket with Minio for local testing when using the S3Hook. If I
specify a connection whose host url is {{localhost}}, the S3Hook fails to connect to the bucket
because it can't infer the region.
> I suspect this is due to a bug in boto:
> One solution would be to upgrade the S3Hook to boto3. If I get the green light, I will
make a PR for that.

This message was sent by Atlassian JIRA

View raw message