spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saisai Shao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-10288) Add a rest client for Spark on Yarn
Date Wed, 02 Sep 2015 06:07:45 GMT

    [ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726814#comment-14726814
] 

Saisai Shao commented on SPARK-10288:
-------------------------------------

Hi [~vanzin], thanks a lot for your comments. Yes it doesn't make sense to compare Yarn with
Standalone and Mesos, and the protocol is also different compared to other two cluster manager.
I will update the description. But to some extent I think rest client is still meaningful
as [~stevel@apache.org] mentioned.

If you have any suggestion please let me know, thanks a lot.

> Add a rest client for Spark on Yarn
> -----------------------------------
>
>                 Key: SPARK-10288
>                 URL: https://issues.apache.org/jira/browse/SPARK-10288
>             Project: Spark
>          Issue Type: New Feature
>          Components: YARN
>            Reporter: Saisai Shao
>
> This is a proposal to add rest client for Spark on Yarn. Currently Spark standalone and
Mesos mode can support rest way of submitting applications, for Spark on Yarn, it still uses
program way to do it. Since RM now (from 2.6) supports rest way of submitting application,
so it would be better Spark on Yarn also support this way.
> Here is the design doc (https://docs.google.com/document/d/1m_P-4olXrp0tJ3kEOLZh1rwrjTfAat7P3fAVPR5GTmg/edit?usp=sharing).
> Currently I'm working on it, working branch is (https://github.com/jerryshao/apache-spark/tree/yarn-rest-support),
the major part is already finished.
> Any comment is greatly appreciated, thanks a lot.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message