spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jais Sebastian (JIRA)" <>
Subject [jira] [Commented] (SPARK-22453) Zookeeper configuration for MesosClusterDispatcher is not documented
Date Wed, 13 Dec 2017 16:39:00 GMT


Jais Sebastian commented on SPARK-22453:

[~srowen] Can you point to the documentation ?

> Zookeeper configuration for MesosClusterDispatcher  is not documented 
> ----------------------------------------------------------------------
>                 Key: SPARK-22453
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: Documentation
>    Affects Versions: 2.2.0
>         Environment: Spark 2.2 with Spark submit
>            Reporter: Jais Sebastian
>            Priority: Minor
> Spark does not have detailed documentation on how to configure zookeeper with MesosClusterDispatcher
. It is mentioned that the configuration is possible and broken documentation link is provided.
> _{{The MesosClusterDispatcher also supports writing recovery state into Zookeeper. This
will allow the MesosClusterDispatcher to be able to recover all submitted and running containers
on relaunch. In order to enable this recovery mode, you can set SPARK_DAEMON_JAVA_OPTS in
spark-env by configuring spark.deploy.recoveryMode and related spark.deploy.zookeeper.* configurations.
For more information about these configurations please refer to the configurations doc.}}_

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message