hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <>
Subject [GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1277: [WIP][HUDI-543] release notes for 0.5.1
Date Sun, 26 Jan 2020 08:20:37 GMT
vinothchandar commented on a change in pull request #1277: [WIP][HUDI-543] release notes for

 File path: docs/_pages/
 @@ -6,6 +6,46 @@ toc: true
 last_modified_at: 2019-12-30T15:59:57-04:00
+## [Release 0.5.1-incubating]
+### Download Information
+ * Source Release : [Apache Hudi(incubating) 0.5.1-incubating Source Release](
+ * Apache Hudi (incubating) jars corresponding to this release is available [here](;quick~hudi)
+### Release Highlights
+* Dependency Version Upgrades
+    * Upgrade from Spark 2.1.0 to Spark 2.4.4
+    * Upgrade from Avro 1.7.7 to Avro 1.8.2
+    * Upgrade from Parquet 1.8.1 to Parquet 1.10.1
+* **IMPORTANT** This version requires your runtime spark version to be upgraded to 2.4+.
+* Hudi now supports both Scala 2.11 and Scala 2.12, please refer to [Build with Scala 2.12](
to build with Scala 2.12.
+Also, the packages hudi-spark, hudi-utilities, hudi-spark-bundle and hudi-utilities-bundle
are changed correspondingly to hudi-spark_{scala_version}, hudi-spark_{scala_version}, hudi-utilities_{scala_version},
hudi-spark-bundle_{scala_version} and hudi-utilities-bundle_{scala_version}.
+Note that scala_version here is one of (2.11, 2.12).
+* With 0.5.1, we added functionality to stop using renames for Hudi timeline metadata operations.
This feature is automatically enabled for newly created Hudi tables. For existing tables,
this feature is turned off by default. Please read this [section](deployment_link), before
enabling this feature for existing hudi table.
+To enable the new hudi timeline layout which avoids renames, use the write config "hoodie.timeline.layout.version=1".
Alternatively, you can use "repair overwrite-hoodie-props" to append the line "hoodie.timeline.layout.version=1"
to Note that in any case, upgrade hudi readers (query engines) first with
0.5.1-incubating release before upgrading writer.
+* CLI supports `repair overwrite-hoodie-props` to overwrite the table's
with specified file.
 Review comment:
   add: specified file, for one-time updates to table name or even enabling the new timeline
layout above. Note that few queries may temporarily fail while the overwrite happens (few

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

With regards,
Apache Git Services

View raw message