spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From andrewor14 <>
Subject [GitHub] spark pull request: [SPARK-8496] [TEST] Do not run slow tests for ...
Date Mon, 13 Jul 2015 21:44:38 GMT
GitHub user andrewor14 reopened a pull request:

    [SPARK-8496] [TEST] Do not run slow tests for every PR

    The purpose of this patch is to speed up the development cycle by separating slow tests
from normal tests. The intention is to run slow tests only in the non-pull-request-builder
Jenkins projects. A slow test is very roughly defined as *a test that takes several seconds
to run on our test machines*.
    In the future we will provide a way for PRs to specify that they do want to run the full

You can merge this pull request into a Git repository by running:

    $ git pull slow-tests

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #6917
commit 9d37185b2c94d1e84ea103eeb660dcef4ee00427
Author: Andrew Or <>
Date:   2015-06-20T02:32:07Z

    Run slow tests only if they are enabled

commit 9bb1f190299feeb40f1f7cdeb64e152b19ef08b9
Author: Andrew Or <>
Date:   2015-06-20T04:55:31Z

    Mark more tests as slow tests

commit b1a2c54fa4124e93e9a49d31490d3dc0cdc69614
Author: Andrew Or <>
Date:   2015-06-22T21:53:57Z

    Fix tests
    These tests actually depend on each other. If we mark the first
    one as a slow test, the rest will throw NPE because the first sets
    a variable that others need.

commit fa36233d9aed893ed44e03f56300d8668bf5ecb2
Author: Andrew Or <>
Date:   2015-06-22T22:01:01Z

    Merge branch 'master' of into slow-tests

commit 5559f2519c162207a7fd9c19682a06fcf2d41765
Author: Andrew Or <>
Date:   2015-06-22T22:21:12Z

    Use scalatest tags instead of environment variables

commit f6c0f464885a458d32a87ff5de7c7ab9f12ff83c
Author: Andrew Or <>
Date:   2015-06-23T18:28:53Z

    Set up tag excludes for SBT and maven
    In both cases, the user specifies the environment variable
    `SPARK_TEST_EXCLUDED_TAGS` before running `dev/`.
    The exclusion logic will then be handled by maven and SBT in
    their own respective ways.
    Note: we still need to make sure the developer has access to
    specific tests on demand. Otherwise if he adds a slow test
    he will have no way to make it run in his PR.

commit cdff98fb8f259f704cde118eba9116426118c103
Author: Andrew Or <>
Date:   2015-06-23T18:43:24Z

    Merge branch 'master' of into slow-tests

commit d59759ee14d7ff016365dedb4fee3ad045e36dbd
Author: Andrew Or <>
Date:   2015-06-23T19:52:22Z

    Fix tests

commit a707b85de8ba8ad89085fc29f2317dc3dfee626a
Author: Andrew Or <>
Date:   2015-06-23T22:29:26Z

    Fix tests


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message