hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14749) review s3guard docs & code prior to merge
Date Fri, 11 Aug 2017 17:01:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123635#comment-16123635
] 

Steve Loughran commented on HADOOP-14749:
-----------------------------------------

I know the answer to that now. I also see that you can configure DDB with an explicit TTL.
If we added a field for each entry as to when the record itself was created, then we could
have AWS TTL do the pruning automatically.

Also, on the CLI I'm getting told off for an encryption key I don' think I've set
{code}
./hadoop s3guard import  s3a://hwdev-steve-ireland-new
2017-08-11 17:56:50,139 INFO Configuration.deprecation: fs.s3a.server-side-encryption-key
is deprecated. Instead, use fs.s3a.server-side-encryption.key
2017-08-11 17:56:50,651 INFO s3guard.S3GuardTool: Metadata store DynamoDBMetadataStore{region=eu-west-1,
tableName=hwdev-steve-ireland-new} is initialized.
Inserted 3 items into Metadata Store
{code}

> review s3guard docs & code prior to merge
> -----------------------------------------
>
>                 Key: HADOOP-14749
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14749
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: documentation, fs/s3
>    Affects Versions: HADOOP-13345
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>         Attachments: HADOOP-14749-HADOOP-13345-001.patch, HADOOP-14749-HADOOP-13345-002.patch,
HADOOP-14749-HADOOP-13345-003.patch, HADOOP-14749-HADOOP-13345-004.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Pre-merge cleanup while it's still easy to do
> * Read through all the docs, tune
> * Diff the trunk/branch files to see if we can reduce the delta (and hence the changes)
> * Review the new tests



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message