hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13931) S3AGuard: Use BatchWriteItem in DynamoDBMetadataStore#put()
Date Wed, 04 Jan 2017 22:18:58 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mingliang Liu updated HADOOP-13931:
-----------------------------------
    Attachment: HADOOP-13931-HADOOP-13345.001.patch

The patch is based on [HADOOP-13934] V5 patch. After that one is committed, we can get this
one in.

Test in US-West-1 region:
{code}
$ mvn -Dtest=none -Dit.test='ITestS3A*' -q clean verify
Results :

Tests in error:
  ITestS3AAWSCredentialsProvider.testAnonymousProvider:133 » IO Failed to instan...
  ITestS3ACredentialsInURL.testInstantiateFromURL:86 » IO Failed to instantiate ...
  ITestS3ACredentialsInURL.testInvalidCredentialsFail:127 » AccessDenied s3a://m...
  ITestS3AFileSystemContract>FileSystemContractBaseTest.testRenameToDirWithSamePrefixAllowed:669->FileSystemContractBaseTest.rename:525
» AWSServiceIO

Tests run: 321, Failures: 0, Errors: 4, Skipped: 43
{code}

> S3AGuard: Use BatchWriteItem in DynamoDBMetadataStore#put()
> -----------------------------------------------------------
>
>                 Key: HADOOP-13931
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13931
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: HADOOP-13345
>            Reporter: Rajesh Balamohan
>            Assignee: Mingliang Liu
>            Priority: Minor
>         Attachments: HADOOP-13931-HADOOP-13345.000.patch, HADOOP-13931-HADOOP-13345.001.patch
>
>
> Using {{batchWriteItem}} might be performant in {{DynamoDBMetadataStore#put(DirListingMetadata
meta)}} and  {{DynamoDBMetadataStore#put(PathMetadata meta)}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message