spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-11843) Isolate staging directory across applications on same YARN cluster
Date Fri, 20 Nov 2015 01:43:11 GMT

     [ https://issues.apache.org/jira/browse/SPARK-11843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marcelo Vanzin resolved SPARK-11843.
------------------------------------
    Resolution: Not A Problem

> Isolate staging directory across applications on same YARN cluster
> ------------------------------------------------------------------
>
>                 Key: SPARK-11843
>                 URL: https://issues.apache.org/jira/browse/SPARK-11843
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>            Reporter: Andrew Or
>            Priority: Minor
>
> If multiple clients share the same YARN cluster and file system they may end up using
the same `.sparkStaging` directory. This may be a problem if their jars are called something
similar, for instance. It would be easier to enforce isolation for both security and user
experience if the staging directories are isolated. We can either:
> (1) allow users to configure the directory name
> (2) add an identifier to the directory name, which I prefer



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message