airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ash Berlin-Taylor (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AIRFLOW-1114) S3Hook doesn't support Minio
Date Tue, 16 Oct 2018 13:39:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ash Berlin-Taylor resolved AIRFLOW-1114.
----------------------------------------
    Resolution: Fixed

Fixed - we upgraded to boto3 across the board for AWS hooks in 1.9? or 1.10

> S3Hook doesn't support Minio
> ----------------------------
>
>                 Key: AIRFLOW-1114
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1114
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: aws, hooks
>    Affects Versions: 1.8.0
>         Environment: I am running it from the following Docker image: https://github.com/puckel/docker-airflow
>            Reporter: Alessandro Cosentino
>            Priority: Major
>
> I want to mock an S3 bucket with Minio for local testing when using the S3Hook. If I
specify a connection whose host url is {{localhost}}, the S3Hook fails to connect to the bucket
because it can't infer the region.
> I suspect this is due to a bug in boto: https://github.com/boto/boto/issues/2624
> One solution would be to upgrade the S3Hook to boto3. If I get the green light, I will
make a PR for that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message