spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Parth Gandhi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode
Date Thu, 31 Aug 2017 16:04:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Parth Gandhi updated SPARK-21888:
---------------------------------
    Description: While running Spark on Yarn in cluster mode, currently there is no way to
add any config files, jars etc. to Client classpath. An example for this is that suppose you
want to run an application that uses hbase. Then, unless and until we do not copy the necessary
config files required by hbase to Spark Config folder, we cannot specify or set their exact
locations in classpath on Client end which we could do earlier by setting the environment
variable "SPARK_CLASSPATH".  (was: While running Spark on Yarn in cluster mode, currently
there is no way to add any config files, jars etc. to Client classpath. An example for this
is that suppose you want to run an application that uses hbase. Then, unless and until we
do not copy the config files to Spark Config folder, we cannot specify or set their exact
locations in classpath on Client end which we could do earlier by setting the environment
variable "SPARK_CLASSPATH".)

> Cannot add stuff to Client Classpath for Yarn Cluster Mode
> ----------------------------------------------------------
>
>                 Key: SPARK-21888
>                 URL: https://issues.apache.org/jira/browse/SPARK-21888
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.2.0
>            Reporter: Parth Gandhi
>            Priority: Minor
>
> While running Spark on Yarn in cluster mode, currently there is no way to add any config
files, jars etc. to Client classpath. An example for this is that suppose you want to run
an application that uses hbase. Then, unless and until we do not copy the necessary config
files required by hbase to Spark Config folder, we cannot specify or set their exact locations
in classpath on Client end which we could do earlier by setting the environment variable "SPARK_CLASSPATH".



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message