hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14068) Add integration test version of TestMetadataStore for DynamoDB
Date Fri, 17 Feb 2017 13:58:41 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871890#comment-15871890
] 

Steve Loughran commented on HADOOP-14068:
-----------------------------------------

FWIW for the s3guard committer, I've seen diffs too, at least from clients of s3a+s3guard.
For testing, it may just be best to switch to the real DDB endpoint everywhere. Removes any
inconsistency (and tracking it down, working around, etc), and increases the likelihood that
test runs will catch any transient failures due to network problems, so give us more stack
traces to deal with.

> Add integration test version of TestMetadataStore for DynamoDB
> --------------------------------------------------------------
>
>                 Key: HADOOP-14068
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14068
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Sean Mackrory
>            Assignee: Sean Mackrory
>         Attachments: HADOOP-14068-HADOOP-13345.001.patch, HADOOP-14068-HADOOP-13345.002.patch
>
>
> I tweaked TestDynamoDBMetadataStore to run against the actual Amazon DynamoDB service
(as opposed to the "local" edition). Several tests failed because of minor variations in behavior.
I think the differences that are clearly possible are enough to warrant extending that class
as an ITest (but obviously keeping the existing test so 99% of the the coverage remains even
when not configured for actual DynamoDB usage).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message