hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore
Date Fri, 30 Dec 2016 09:24:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15787295#comment-15787295
] 

Mingliang Liu commented on HADOOP-13908:
----------------------------------------

Tests in US-West-1 region with the DynamoDB table existent and nonexistent before the tests.
{code}
Tests in error:
  ITestS3AAWSCredentialsProvider.testAnonymousProvider:133 » AWSServiceIO initTa...
  ITestS3ADeleteManyFiles.testBulkRenameAndDelete:101 » AWSServiceIO move: com.a...
  ITestS3ADeleteFilesOneByOne>ITestS3ADeleteManyFiles.testBulkRenameAndDelete:101 » AWSServiceIO
  ITestS3AFileSystemContract>FileSystemContractBaseTest.testRenameToDirWithSamePrefixAllowed...
  ITestS3ACredentialsInURL.testInvalidCredentialsFail:127 » AccessDenied s3a://m...
{code}
The failing tests seem not related and they fail without this patch. {{ITestS3AAWSCredentialsProvider}}
and {{ITestS3ACredentialsInURL}} we track in [HADOOP-13876]. For the rename related three
ones, I didn't seem them consistently fail before though. I think they're related to [HADOOP-13934]
and hopefully it will address them.

> S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore
> ----------------------------------------------------------------------------------
>
>                 Key: HADOOP-13908
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13908
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: HADOOP-13345
>            Reporter: Mingliang Liu
>            Assignee: Mingliang Liu
>         Attachments: HADOOP-13908-HADOOP-13345.000.patch, HADOOP-13908-HADOOP-13345.001.patch,
HADOOP-13908-HADOOP-13345.002.patch, HADOOP-13908-HADOOP-13345.002.patch, HADOOP-13908-HADOOP-13345.003.patch
>
>
> This was based on discussion in [HADOOP-13455]. Though we should not create table unless
the config {{fs.s3a.s3guard.ddb.table.create}} is set true, we still have to get the existing
table in {{DynamoDBMetadataStore#initialize()}} and wait for its becoming active, before any
table/item operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message