spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj K (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts
Date Tue, 25 Jul 2017 14:05:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16100079#comment-16100079
] 

Devaraj K commented on SPARK-15142:
-----------------------------------

bq. That means there is no way to detect the new master while the dispatcher is still alive,
it must be restarted when the new master is up, correct?

Yes, the https://github.com/apache/spark/pull/13143 doesn't handle discovery of new master
when the dispatcher is still alive. You can reopen this jira and create a PR if you want to
work on.

> Spark Mesos dispatcher becomes unusable when the Mesos master restarts
> ----------------------------------------------------------------------
>
>                 Key: SPARK-15142
>                 URL: https://issues.apache.org/jira/browse/SPARK-15142
>             Project: Spark
>          Issue Type: Bug
>          Components: Deploy, Mesos
>            Reporter: Devaraj K
>            Priority: Minor
>         Attachments: spark-devaraj-org.apache.spark.deploy.mesos.MesosClusterDispatcher-1-stobdtserver5.out
>
>
> While Spark Mesos dispatcher running if the Mesos master gets restarted then Spark Mesos
dispatcher will keep running and queues up all the submitted applications and will not launch
them.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message