spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Liang-Chi Hsieh <vii...@gmail.com>
Subject Re: Accessing Hive Tables in Spark
Date Thu, 12 Apr 2018 14:48:55 GMT

Seems like Spark can't access hive-site.xml under cluster mode. One solution
is to add the config `spark.yarn.dist.files=/path/to/hive-site.xml` to your
spark-defaults.conf. And don't forget to call `enableHiveSupport()` on
`SparkSession`.


Tushar Singhal wrote
> Hi Everyone,
> 
> I was accessing Hive Tables in Spark SQL using Scala submitted by
> spark-submit command.
> When I ran in cluster mode then got error like : Table not found
> But the same is working while submitted as client mode.
> Please help me to understand why?
> 
> Distribution : Hortonworks
> 
> Thanks in advance !!





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Mime
View raw message