hudi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "" <>
Subject Re: Hoodie dataset write without partition
Date Mon, 24 Jun 2019 21:57:36 GMT
Hi Amarnath,
Apart from changing the partition extractor class, you would need to change the keyGeneratorClass
for non-partitioned table.
Use this param "--key-generator-class com.uber.hoodie.NonpartitionedKeyGenerator" as part
of DeltaStreamer command-line execution.
Also, ensure we have the following configs defined in the properties file used by delta-streamer:
will eventually remove the DeltaStreamer CLI and rely on the properties config for uniform

    On Monday, June 24, 2019, 1:55:51 PM PDT, Balaji Varadarajan <>
  Hi Amarnath,
I will look into it and reply back by EOD today.
    On Sunday, June 23, 2019, 8:21:51 AM PDT, Amarnath Venkataswamy <>

Is there any option to write the hoodie dataset without any partition?

I tried but hive sync is failing when you sync up without any partition.

Delta streamer creates with default as partition when there is no partition column.

Sent from my iPhone    
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message