spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-1110) Clean up and clarify use of SPARK_HOME
Date Fri, 16 May 2014 10:48:52 GMT

     [ https://issues.apache.org/jira/browse/SPARK-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Patrick Wendell resolved SPARK-1110.
------------------------------------

    Resolution: Fixed

This was subsumed by the other configuration clean-up.

> Clean up and clarify use of SPARK_HOME
> --------------------------------------
>
>                 Key: SPARK-1110
>                 URL: https://issues.apache.org/jira/browse/SPARK-1110
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Patrick Wendell
>            Assignee: Patrick Cogan
>             Fix For: 1.0.0
>
>
> In the spirit of SPARK-929 we should clean up the use of SPARK_HOME and, if possible,
remove it entirely.
> We need to look through what this is used for. One use was allowing applications to run
different versions of Spark in standalone mode. For instance, someone could submit an application
with a custom SPARK_HOME and the Worker would launch an Executor using a different path for
Spark. This use case is not widely used and maybe should just be removed.
> The existing constructors that take SPARK_HOME for this purpose should be deprecated
and we should explain that SPARK_HOME is no longer used for this purpose.
> If there are other legitimate reasons for SPARK_HOME, we can keep it around... we need
to audit the uses of it.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message