hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-15201) Automatically determine region & hence S3 endpoint of buckets
Date Wed, 31 Jan 2018 21:00:03 GMT
Steve Loughran created HADOOP-15201:

             Summary: Automatically determine region & hence S3 endpoint of buckets
                 Key: HADOOP-15201
                 URL: https://issues.apache.org/jira/browse/HADOOP-15201
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: 3.0.0
            Reporter: Steve Loughran

Use {{getBucketLocation}} to determine location & map to endpoint, if fs.s3a.endpoint
is set to "automatic"

S3guard added the API call {{String getBucketLocation()}}, which is used for DDB binding,
We can also use this to determine the s3 endpoint, to avoid recurrent issues with auth failures
related to it not being valid

Still need to handle: buckets on third-party servers, and the inevitability that new AWS regions
will be added after the Hadoop version & AWS Jar is shipped and frozen

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

View raw message