hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Bota (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HADOOP-15428) s3guard bucket-info will create s3guard table if FS is set to do this automatically
Date Tue, 04 Dec 2018 14:42:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708785#comment-16708785
] 

Gabor Bota edited comment on HADOOP-15428 at 12/4/18 2:41 PM:
--------------------------------------------------------------

submitted patch v001, tested against eu-west-1. 
Issues:
* org.apache.hadoop.fs.s3a.yarn.ITestS3AMiniYarnCluster#testWithMiniCluster (known)
* ITestS3GuardToolDynamoDB#testPruneCommandCLI (added to [S3 flakyness collecting spreadsheet|https://docs.google.com/spreadsheets/d/1Z9dkg5yC7Hu7VQ5G2Wz40hG1pb0DhLuLjJ3PZe7WL3Q/edit?usp=sharing])

These issues are not related.




was (Author: gabor.bota):
submitted patch v001, tested against eu-west-1. 
Issues:
* org.apache.hadoop.fs.s3a.yarn.ITestS3AMiniYarnCluster#testWithMiniCluster (known)
* ITestS3GuardToolDynamoDB#testPruneCommandCLI (added to [S3 flakyness collecting spreadsheet|
https://docs.google.com/spreadsheets/d/1Z9dkg5yC7Hu7VQ5G2Wz40hG1pb0DhLuLjJ3PZe7WL3Q/edit?usp=sharing])

These issues are not related.



> s3guard bucket-info will create s3guard table if FS is set to do this automatically
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-15428
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15428
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.1.0
>            Reporter: Steve Loughran
>            Assignee: Gabor Bota
>            Priority: Major
>         Attachments: HADOOP-15428.001.patch
>
>
> If you call hadoop s3guard bucket-info on a bucket where the fs is set to create a s3guard
table on demand, then the DDB table is automatically created. As a result
> the {{bucket-info -unguarded}} option cannot be used, and the call has significant side
effects (i.e. it can run up bills)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message