spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: [SPARK-10046][SQL] Hive warehouse dir not set in current directory when not …
Date Sun, 08 Nov 2015 20:28:23 GMT
Repository: spark
Updated Branches:
  refs/heads/master 30c8ba71a -> 26739059b

[SPARK-10046][SQL] Hive warehouse dir not set in current directory when not …

Doc change to align with HiveConf default in terms of where to create `warehouse` directory.

Author: xin Wu <>

Closes #9365 from xwu0226/spark-10046-commit.


Branch: refs/heads/master
Commit: 26739059bc39cd7aa7e0b1c16089c1cf8d8e4d7d
Parents: 30c8ba7
Author: xin Wu <>
Authored: Sun Nov 8 12:28:19 2015 -0800
Committer: Reynold Xin <>
Committed: Sun Nov 8 12:28:19 2015 -0800

 docs/ | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/docs/ b/docs/
index 0858741..52e03b9 100644
--- a/docs/
+++ b/docs/
@@ -1627,8 +1627,10 @@ YARN cluster. The convenient way to do this is adding them through
the `--jars`
 When working with Hive one must construct a `HiveContext`, which inherits from `SQLContext`,
 adds support for finding tables in the MetaStore and writing queries using HiveQL. Users
who do
 not have an existing Hive deployment can still create a `HiveContext`.  When not configured
by the
-hive-site.xml, the context automatically creates `metastore_db` and `warehouse` in the current
+hive-site.xml, the context automatically creates `metastore_db` in the current directory
+creates `warehouse` directory indicated by HiveConf, which defaults to `/user/hive/warehouse`.
+Note that you may need to grant write privilege on `/user/hive/warehouse` to the user who
+the spark application.
 {% highlight scala %}
 // sc is an existing SparkContext.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message