spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saisai Shao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-26516) zeppelin with spark on mesos: environment variable setting
Date Thu, 03 Jan 2019 02:04:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732587#comment-16732587
] 

Saisai Shao commented on SPARK-26516:
-------------------------------------

Questions should go to user@spark mail list. Also if this is a problem of Zeppelin, it would
be better to ask in the Zeppelin mail list.

> zeppelin with spark on mesos: environment variable setting
> ----------------------------------------------------------
>
>                 Key: SPARK-26516
>                 URL: https://issues.apache.org/jira/browse/SPARK-26516
>             Project: Spark
>          Issue Type: Question
>          Components: Mesos, Spark Core
>    Affects Versions: 2.4.0
>            Reporter: Yui Hirasawa
>            Priority: Major
>
> I am trying to use zeppelin with spark on mesos mode following [Apache Zeppelin on
Spark Cluster Mode|https://zeppelin.apache.org/docs/0.8.0/setup/deployment/spark_cluster_mode.html#4-configure-spark-interpreter-in-zeppelin-1].
> In the instruction, we should set these environment variables:
> {code:java}
> export MASTER=mesos://127.0.1.1:5050
> export MESOS_NATIVE_JAVA_LIBRARY=[PATH OF libmesos.so]
> export SPARK_HOME=[PATH OF SPARK HOME]
> {code}
> As far as I know, these environment variables are used by zeppelin, so it should be set
in localhost rather than in docker container(if i am wrong please correct me).
> But mesos and spark is running inside docker container, so do we need to set these environment
variables so that they are pointing to the path inside the docker container? If so, how should
one achieve that?
> Thanks in advance.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message