spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Or (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode
Date Thu, 05 Feb 2015 03:05:34 GMT

     [ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Or updated SPARK-5388:
-----------------------------
    Description: The existing submission gateway in standalone mode is not compatible across
Spark versions. If you have a newer version of Spark submitting to an older version of the
standalone Master, it is currently not guaranteed to work. The goal is to provide a stable
REST interface to replace this channel.  (was: The existing submission gateway in standalone
mode is not compatible across Spark versions. If you have a newer version of Spark submitting
to an older version of the standalone Master, it is currently not guaranteed to work. The
goal is to provide a stable REST interface to replace this channel.

The first cut implementation will target standalone cluster mode because there are very few
messages exchanged. The design, however, should be general enough to potentially support this
for other cluster managers too. Note that this is not necessarily required in YARN because
we already use YARN's stable interface to submit applications there.)

> Provide a stable application submission gateway in standalone cluster mode
> --------------------------------------------------------------------------
>
>                 Key: SPARK-5388
>                 URL: https://issues.apache.org/jira/browse/SPARK-5388
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.2.0
>            Reporter: Andrew Or
>            Assignee: Andrew Or
>            Priority: Blocker
>         Attachments: stable-spark-submit-in-standalone-mode-2-4-15.pdf
>
>
> The existing submission gateway in standalone mode is not compatible across Spark versions.
If you have a newer version of Spark submitting to an older version of the standalone Master,
it is currently not guaranteed to work. The goal is to provide a stable REST interface to
replace this channel.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message