spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saisai Shao (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-26516) zeppelin with spark on mesos: environment variable setting
Date Thu, 03 Jan 2019 02:06:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Saisai Shao resolved SPARK-26516.
---------------------------------
    Resolution: Invalid

> zeppelin with spark on mesos: environment variable setting
> ----------------------------------------------------------
>
>                 Key: SPARK-26516
>                 URL: https://issues.apache.org/jira/browse/SPARK-26516
>             Project: Spark
>          Issue Type: Question
>          Components: Mesos, Spark Core
>    Affects Versions: 2.4.0
>            Reporter: Yui Hirasawa
>            Priority: Major
>
> I am trying to use zeppelin with spark on mesos mode following [Apache Zeppelin on
Spark Cluster Mode|https://zeppelin.apache.org/docs/0.8.0/setup/deployment/spark_cluster_mode.html#4-configure-spark-interpreter-in-zeppelin-1].
> In the instruction, we should set these environment variables:
> {code:java}
> export MASTER=mesos://127.0.1.1:5050
> export MESOS_NATIVE_JAVA_LIBRARY=[PATH OF libmesos.so]
> export SPARK_HOME=[PATH OF SPARK HOME]
> {code}
> As far as I know, these environment variables are used by zeppelin, so it should be set
in localhost rather than in docker container(if i am wrong please correct me).
> But mesos and spark is running inside docker container, so do we need to set these environment
variables so that they are pointing to the path inside the docker container? If so, how should
one achieve that?
> Thanks in advance.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message