hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14023) S3Guard: DynamoDBMetadataStore logs nonsense region
Date Fri, 03 Mar 2017 22:06:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895107#comment-15895107

Mingliang Liu commented on HADOOP-14023:

[~mackrorysd] can you confirm that the problem is gone because of recent JIRA [HADOOP-14130]?
If not, we may have to rebase the patch anyway for a new fix.

> S3Guard: DynamoDBMetadataStore logs nonsense region
> ---------------------------------------------------
>                 Key: HADOOP-14023
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14023
>             Project: Hadoop Common
>          Issue Type: Sub-task
>    Affects Versions: HADOOP-13345
>            Reporter: Sean Mackrory
>            Assignee: Sean Mackrory
>            Priority: Minor
>         Attachments: HADOOP-14023-HADOOP-13345.001.patch
> When you specify a DynamoDB endpoint instead of it using the same one as the S3 bucket,
it thinks the region is "dynamodb":
> {code}
> > bin/hadoop s3a init -m dynamodb://region-test
> 2017-01-25 11:41:28,006 INFO s3guard.S3GuardTool: create metadata store: dynamodb://region-test
scheme: dynamodb
> 2017-01-25 11:41:28,116 WARN util.NativeCodeLoader: Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
> 2017-01-25 11:41:29,421 INFO s3guard.DynamoDBMetadataStore: Creating non-existent DynamoDB
table region-test in region dynamodb
> 2017-01-25 11:41:34,637 INFO s3guard.S3GuardTool: Metadata store DynamoDBMetadataStore{region=dynamodb,
tableName=region-test} is initialized.
> {code}
> My guess is it's because of DynamoDBMetadataStore.initialize will call getEndpointPrefix,
and all the published endpoints for DynamoDB actually start with dynamodb.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message