hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Mitic (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9287) Parallel testing hadoop-common
Date Sat, 04 May 2013 16:52:15 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649109#comment-13649109

Ivan Mitic commented on HADOOP-9287:

Thanks folks for working on this! The community will find this super useful!

I went over the patch and the approach from the patch and have a couple of suggestions/comments:
 - As part of this effort, it would be good to enumerate patterns that can cause concurrent
tests to fail (you guys must know them already :)). One is local file system conflict. Another
could be conflict on ports. This would be of great help for future development so that the
community can keep a watch on those.
 - Instead of changing individual tests to use unique test folder paths, couldn't we just
reconfigure test.build.data from the outside (from maven)? This would make tests changes minimal/unnecessary
in most cases. The general guideline is to have all tests write local files under test.build.data,
so if we have tests that violate this, that's a bug.

IMO, it would be really good if we could have a clear set of guidelines that would allow us
to reconfigure tests from the outside and have them run in parallel with no conflicts. Not
sure how much effort this is, so just putting it on the table. Hope this helps!

> Parallel testing hadoop-common
> ------------------------------
>                 Key: HADOOP-9287
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9287
>             Project: Hadoop Common
>          Issue Type: Test
>          Components: test
>    Affects Versions: 3.0.0
>            Reporter: Tsuyoshi OZAWA
>            Assignee: Andrey Klochkov
>         Attachments: HADOOP-9287.1.patch, HADOOP-9287--N3.patch, HADOOP-9287--N3.patch,
HADOOP-9287--N4.patch, HADOOP-9287--N5.patch, HADOOP-9287.patch, HADOOP-9287.patch
> The maven surefire plugin supports parallel testing feature. By using it, the tests can
be run more faster.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message