hudi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From leesf <>
Subject [ANNOUNCE] Hudi Community Update(2021-06-06 ~ 2021-06-20)
Date Sun, 20 Jun 2021 15:19:00 GMT
Dear community,

Nice to share Hudi community bi-weekly updates for 2021-06-06 ~ 2021-06-20
with updates on features, bug fixes and tests.


[CLI] Add fetching latest schema to table command in hudi-cli [1]
[Spark Integration] Added support for SqlFileBasedTransformer [2]
[Flink Integration] add BootstrapFunction to support index bootstrap [3]
[Spark Integration] Basic Implement Of Spark Sql Support For Hoodie [4]
[Core] Support configure KeyGenerator by type [5]
[Spark Integration] Added SqlSource to fetch data from any partitions for
backfill use case [6]
[Flink Integration] Support independent flink hudi compaction function [7]
[Core] ORC reader writer Implementation [8]
[Flink Integration] Support flink hive sync in batch mode [9]
[Flink Integration] Add metadata cache to WriteProfile to reduce IO [10]
[Flink Integration] Make flink writer as exactly-once by default [11]
[Deltasteramer] Adds JDBC source support for DeltaStreamer [12]



[Spark Integration] Add Default value for HIVE_AUTO_CREATE_DATABASE_OPT_KEY
in HoodieSparkSqlWriter [1]
[Flink Integration] BucketAssignFunction use ValueState instead of MapState
[Flink Integration] Skip Commits with empty files [3]
[Core] Fix NPE when avro field value is null [4]
[Flink Integration] Skip creating marker files for flink merge handle [5]
[Flink Integration] Fix non partition table hive meta sync for flink writer
[Flink Integration] Release the new records map for merge handle #close [7]
[Flink Integration] Release the new records iterator for append handle
#close [8]
[Flink Integratoin] Release file writer for merge handle #close [9]
[Spark Integration] Fixing drop dups exception in bulk insert row writer
path [10]
[Flink Integration] Refresh the base file view cache for WriteProfile [11]
[Flink Integration] Release writer for append handle #close [12]
[Code Cleanup] Avoid the raw type usage in some classes under
hudi-utilities module [13]
[Core] Fix the filter condition is missing in the judgment condition of
compaction instance [14]
[Flink Integration] Fix flink operator uid to allow multiple pipelines in
one job [15]
[Spaark Integration] Fix RO Tables Returning Snapshot Result [16]
[Spark Integration] Set up the file system view storage config for
singleton embedded server write config every time [17]
[Flink Integration] Make keygen class and keygen type optional for
FlinkStreamerConfig [18]
[Spark Integration] ClassCastException Throw When PreCombineField Is String
Type [19]
[Flink Integration] Move the compaction plan scheduling out of flink writer
coordinator [20]



[Tests] Move TestHiveMetastoreBasedLockProvider to functional [1]
[Tests] Move CheckpointUtils test cases to independant class [2]
[Tests] Fix Azure CI failure in TestParquetUtils [3]



  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message