hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9287) Parallel testing hadoop-auth and hadoop-common
Date Wed, 06 Feb 2013 16:43:12 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13572554#comment-13572554
] 

Chris Nauroth commented on HADOOP-9287:
---------------------------------------

It would be great to speed up the tests, but we might need to make some changes in our test
code to guarantee that each test is isolated from any other tests that could be running in
parallel.

One example is {{TestLocalFSFileContextMainOperations}} and {{TestFcMainOperationsLocalFs}}.
 Both of these are subclasses of {{FileContextMainOperationsBaseTest}}.  The base class contains
the logic for setting up the test root directory:

{code}
  static {
    File testBuildData = new File(System.getProperty("test.build.data",
                                    "build/test/data"));
    Path localFsRootPath = new Path(testBuildData.getAbsolutePath(), 
                                    "root-uri");
    LOCAL_FS_ROOT_PATH = localFsRootPath.makeQualified(LocalFileSystem.NAME, null);
  }
{code}

If I understand the behavior of <parallel>classes</parallel>, then it means {{TestLocalFSFileContextMainOperations}}
and {{TestFcMainOperationsLocalFs}} could get scheduled for parallel execution, and they both
would operate on the same {{LOCAL_FS_ROOT_PATH}}.  The tests could interfere with each other
by creating or deleting unexpected files and cause spurious test failures.

This is just one example off the top of my head.  There could be other test isolation issues.

                
> Parallel testing hadoop-auth and hadoop-common
> ----------------------------------------------
>
>                 Key: HADOOP-9287
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9287
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 3.0.0
>            Reporter: Tsuyoshi OZAWA
>            Assignee: Tsuyoshi OZAWA
>         Attachments: HADOOP-9287.1.patch
>
>
> The maven surefire plugin supports parallel testing feature. By using it, the tests can
be run more faster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message