hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when changing from hoodie to hudi?
Date Thu, 20 Feb 2020 01:58:58 GMT
lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when
changing from hoodie to hudi?
URL: https://github.com/apache/incubator-hudi/issues/1342#issuecomment-588567557
 
 
   hi @tooptoop4, I test it in my local env. No need to run any convert utility.
   
   **Notice:**
   - Change `com.uber.hoodie` to `org.apache.hudi`
   - Better to improve spark to 2.4.4 version
   - Add `org.apache.spark:spark-avro_2.11:2.4.4` to start command
   ```
   bin/spark-shell \
     --packages org.apache.hudi:hudi-spark-bundle_2.11:0.5.1-incubating,org.apache.spark:spark-avro_2.11:2.4.4
\
     --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'
   ```
   
   <br>
   
   More, from `0.4.6` to `0.5.1` is a big version change, I suggest that you'd better test
it with some old cow tables in your environment. If you meet some issue, you can ask us at
any time.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message