beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From amarouni <...@git.apache.org>
Subject [GitHub] incubator-beam pull request: [BEAM-313] Enable the use of an existing spark ...
Date Tue, 31 May 2016 13:43:14 GMT
GitHub user amarouni opened a pull request:

    https://github.com/apache/incubator-beam/pull/401

    [BEAM-313] Enable the use of an existing spark context with the SparkPipelineRunner

    The general use case is that the SparkPipelineRunner creates its own Spark context and
uses it for the pipeline execution.
    Another alternative is to provide the SparkPipelineRunner with an existing spark context.
This can be interesting for a lot of use cases where the Spark context is managed outside
of beam (context reuse, advanced context management, spark job server, ...).

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/amarouni/incubator-beam mycbeam313

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/401.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #401
    
----
commit fec04dee06cad9bb6d8914c6ba027a5574c73e41
Author: Abbass MAROUNI <amarouni@talend.com>
Date:   2016-05-31T12:45:32Z

    [BEAM-313] Enable the use of an existing spark context with the SparkPipelineRunner

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message