spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [spark] wangyum commented on a change in pull request #25431: [SPARK-28711][DOCS] Update migration guide to add note about Hive upgrade
Date Wed, 14 Aug 2019 06:20:50 GMT
wangyum commented on a change in pull request #25431: [SPARK-28711][DOCS] Update migration
guide to add note about Hive upgrade
URL: https://github.com/apache/spark/pull/25431#discussion_r313718805
 
 

 ##########
 File path: docs/sql-migration-guide-upgrade.md
 ##########
 @@ -23,6 +23,9 @@ license: |
 {:toc}
 
 ## Upgrading From Spark SQL 2.4 to 3.0
+  - Since Spark 3.0, hive is upgraded to 2.3.x, so it is required to update the Hive
 
 Review comment:
   There are two things here:
   1. If you want to improve the performance of the Hive Metastore Server. The correct way
is to upgrade your Hive Metastore Server to latest version. `SCHEMA_VERSION` should be updated
by [Hive itself](https://github.com/apache/hive/blob/c57a59611fa168ee38c6ee0ee60b1d6c4994f9f8/metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-1.3.0.mysql.sql).
   2. Upgrade built-in Hive to 2.3.x still can get benefits if you Hive Metastore Server is
1.2.x, such as [SPARK-12014](https://issues.apache.org/jira/browse/SPARK-12014), [SPARK-27500](https://issues.apache.org/jira/browse/SPARK-27500)
and [SPARK-26321](https://issues.apache.org/jira/browse/SPARK-26321).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message