spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Iulian Dragos (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-12423) Mesos executor home should not be resolved on the driver's file system
Date Tue, 02 Feb 2016 10:38:39 GMT

     [ https://issues.apache.org/jira/browse/SPARK-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Iulian Dragos resolved SPARK-12423.
-----------------------------------
    Resolution: Fixed

> Mesos executor home should not be resolved on the driver's file system
> ----------------------------------------------------------------------
>
>                 Key: SPARK-12423
>                 URL: https://issues.apache.org/jira/browse/SPARK-12423
>             Project: Spark
>          Issue Type: Bug
>          Components: Mesos
>    Affects Versions: 1.6.0
>            Reporter: Iulian Dragos
>
> {{spark.mesos.executor.home}} should be an uninterpreted string. It is very possible
that this path does not exist on the driver, and if it does, it may be a symlink that should
not be resolved. Currently, this leads to failures in client mode.
> For example, setting it to {{/var/spark/spark-1.6.0-bin-hadoop2.6/}} leads to executors
failing:
> {code}
> sh: 1: /private/var/spark/spark-1.6.0-bin-hadoop2.6/bin/spark-class: not found
> {code}
> {{getCanonicalPath}} transforms {{/var/spark...}} into {{/private/var..}} because on
my system there is a symlink from one to the other.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message