hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-15576) S3A Multipart Uploader API implementation to work with S3Guard
Date Mon, 02 Jul 2018 14:01:00 GMT
Steve Loughran created HADOOP-15576:

             Summary: S3A  Multipart Uploader API implementation to work with S3Guard
                 Key: HADOOP-15576
                 URL: https://issues.apache.org/jira/browse/HADOOP-15576
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: 3.2
            Reporter: Steve Loughran
            Assignee: Ewan Higgs

The new Multipart Uploader API of HDFS-13186 needs to work with S3Guard, with the tests to
demonstrate this

# move from low-level calls of S3A client to calls of WriteOperationHelper; adding any new
methods are needed there.
# Tests. the tests of HDFS-13713. 
# test execution, with -DS3Guard, -DAuth

There isn't an S3A version of {{AbstractSystemMultipartUploaderTest}}, and even if there was,
it might not show that S3Guard was bypassed, because there's no checks that listFiles/listStatus
shows the newly committed files.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message