spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lovexi <>
Subject [GitHub] spark pull request #14110: [SPARK-16455] Add isClusterAvailableForNewOffers ...
Date Fri, 08 Jul 2016 23:44:32 GMT
GitHub user lovexi opened a pull request:

    [SPARK-16455] Add isClusterAvailableForNewOffers hook to check cluster availability

    ## What changes were proposed in this pull request?
    In our case, we are implementing restartable resource manager mechanism which will let
master executor survive when resource manager service is temporarily down. So when resource
manager service is not available, scheduler should stop scheduling new tasks. I added a hook
inside CoarseGrainedSchedulerBackend class, in order to avoid new task scheduling when it's
    JIRA link:

You can merge this pull request into a Git repository by running:

    $ git pull scheduler

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #14110
commit 4f05f58544dee7606d4faf6864f84135e89934d1
Author: Yangyang Liu <>
Date:   2016-07-08T23:39:40Z

    Add isClusterAvailableForNewOffers hook to check cluster availability


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message