spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Imran Rashid (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-11035) Launcher: allow apps to be launched in-process
Date Thu, 28 Dec 2017 22:52:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Imran Rashid reassigned SPARK-11035:
------------------------------------

    Assignee: Marcelo Vanzin

> Launcher: allow apps to be launched in-process
> ----------------------------------------------
>
>                 Key: SPARK-11035
>                 URL: https://issues.apache.org/jira/browse/SPARK-11035
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core
>    Affects Versions: 1.6.0
>            Reporter: Marcelo Vanzin
>            Assignee: Marcelo Vanzin
>
> The launcher library is currently restricted to launching apps as child processes. That
is fine for a lot of cases, especially if the app is running in client mode.
> But in certain cases, especially launching in cluster mode, it's more efficient to avoid
launching a new process, since that process won't be doing much.
> We should add support for launching apps in process, even if restricted to cluster mode
at first. This will require some rework of the launch paths to avoid using system properties
to propagate configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message