hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13446) Support running isolated unit tests separate from AWS integration tests.
Date Mon, 22 Aug 2016 05:44:22 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Nauroth updated HADOOP-13446:
-----------------------------------
    Attachment: HADOOP-13446.006.patch

I discovered that the patch wouldn't work for branch-2, because branch-2 has an additional
test suite: {{TestS3ADeleteFilesOneByOne}}.  From what I can tell, it's simply an oversight
that this test suite is missing from trunk.  It was introduced in HADOOP-12292.  The trunk
commit doesn't have the file, but the branch-2 commit does have it.  I'm going to take the
opportunity to get that file in agreement between trunk and branch-2 with this patch.  I'm
attaching patch 006, which adds {{ITestS3ADeleteFilesOneByOne}}.

Even still, this is incomplete for branch-2.  On branch-2, we also need to convert the s3://
tests, which are no longer present in trunk.  I'll have a separate branch-2 patch forthcoming.

> Support running isolated unit tests separate from AWS integration tests.
> ------------------------------------------------------------------------
>
>                 Key: HADOOP-13446
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13446
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: HADOOP-13446-HADOOP-13345.001.patch, HADOOP-13446-HADOOP-13345.002.patch,
HADOOP-13446-HADOOP-13345.003.patch, HADOOP-13446.004.patch, HADOOP-13446.005.patch, HADOOP-13446.006.patch
>
>
> Currently, the hadoop-aws module only runs Surefire if AWS credentials have been configured.
 This implies that all tests must run integrated with the AWS back-end.  It also means that
no tests run as part of ASF pre-commit.  This issue proposes for the hadoop-aws module to
support running isolated unit tests without integrating with AWS.  This will benefit S3Guard,
because we expect the need for isolated mock-based testing to simulate eventual consistency
behavior.  It also benefits hadoop-aws in general by allowing pre-commit to do something more
valuable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message