flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tillrohrmann <...@git.apache.org>
Subject [GitHub] flink pull request #4261: [FLINK-7082] Add generic entry point for session a...
Date Wed, 05 Jul 2017 13:34:15 GMT
GitHub user tillrohrmann opened a pull request:

    https://github.com/apache/flink/pull/4261

    [FLINK-7082] Add generic entry point for session and per-job clusters

    This PR is based on #4260 and #4259.
    
    This PR introduces a generic entry point `ClusterEntrypoint` for Flink clusters. `ClusterEntrypoint`
performs common operations like parsing command line options, loading the Flink configuration
and setting up common services (e.g. `RPCService`).
    
    The two sub classes `JobClusterEntrypoint` and `SessionClusterEntrypoint` are the specialization
for the per-job and session mode. The former entrypoint spawns a `ResourceManager`, tries
to retrieve the `JobGraph` and then launches a `JobManagerRunner` with the retrieved `JobGraph`.
The latter starts a `ResourceManager` and the `Dispatcher` component in order to receive job
submissions.
    
    The PR also includes a specialization of the `SessionClusterEntrypoint` which is the `StandaloneSessionClusterEntrypoint`.
This class simply spawns the `StandaloneResourceManager` for a standalone session cluster.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tillrohrmann/flink addClusterEntrypoint

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/4261.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4261
    
----
commit cba1cb11a3eaaea3511120fa7864028a2c47e6a5
Author: Till Rohrmann <trohrmann@apache.org>
Date:   2017-07-04T21:15:52Z

    [FLINK-7103] [dispatcher] Add skeletal structure of Dispatcher component
    
    The Dispatcher is responsible for receiving job submissions, persisting the JobGraphs,
    spawning JobManager to execute the jobs and recovering the jobs in case of a master
    failure. This commit adds the basic skeleton including the RPC call for job submission.
    
    Add cleanup logic for finished jobs
    
    Pass BlobService to JobManagerRunner

commit 476239fb52ef45926b0a28b97339158b8095bc3c
Author: Till Rohrmann <trohrmann@apache.org>
Date:   2017-07-04T15:47:37Z

    [FLINK-7082] Add generic entry point for session and per-job clusters

commit 4c45f574d66cab076b7711696c0edbb485cb3cd4
Author: Till Rohrmann <trohrmann@apache.org>
Date:   2017-07-05T11:38:35Z

    [FLINK-7105] Make ActorSystems non daemonic
    
    In order to not having to explicitly wait on the termination of an ActorSystem
    in the main thread, we now create the ActorSystems in non-daemonic mode. That
    way the process won't terminate if there is still an active actor.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message