hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Bota (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15847) S3Guard testConcurrentTableCreations to set r & w capacity == 1
Date Mon, 17 Dec 2018 16:01:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723108#comment-16723108

Gabor Bota commented on HADOOP-15847:

Hey [~Jack-Lee], thanks for the patch!

The exception you got is because of you got throttled by aws, please try to re-run the test,
you should be fine after that. 

Looking at your patch you've made modification in {{S3AScaleTestBase}}, but this issue is
about changing the r&w capacity first only in {{ITestS3GuardConcurrentOps}} I'm afraid.
Could you clarify how will a change in {{S3AScaleTestBase}} affect {{ITestS3GuardConcurrentOps}}?

> S3Guard testConcurrentTableCreations to set r & w capacity == 1
> ---------------------------------------------------------------
>                 Key: HADOOP-15847
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15847
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3, test
>    Affects Versions: 3.2.0
>            Reporter: Steve Loughran
>            Assignee: lqjacklee
>            Priority: Major
>         Attachments: HADOOP-15847-001.patch
> I just found a {{testConcurrentTableCreations}} DDB table lurking in a region, presumably
from an interrupted test. Luckily test/resources/core-site.xml forces the r/w capacity to
be 10, but it could still run up bills.
> Recommend
> * explicitly set capacity = 1 for the test
> * and add comments in the testing docs about keeping cost down.
> I think we may also want to make this a scale-only test, so it's run less often

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message